Time Namespace Component RelatedObject Reason Message

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js to ip-10-0-138-163.ec2.internal

openshift-ingress

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6 to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2 to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l to ip-10-0-138-163.ec2.internal

openshift-ingress

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4 to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg to ip-10-0-138-109.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-pnh69

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-pnh69 to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9 to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266 to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6 to ip-10-0-138-109.ec2.internal

openshift-ingress

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6 to ip-10-0-138-109.ec2.internal

openshift-ingress

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt to ip-10-0-132-10.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-klmb9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-klmb9 to ip-10-0-132-10.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-596h4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-596h4 to ip-10-0-138-163.ec2.internal

openshift-ingress

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq to ip-10-0-138-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84 to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7 to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49 to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf to ip-10-0-132-10.ec2.internal

openshift-ingress

kube-auth-proxy-694bf5b6d6-f64vz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-694bf5b6d6-f64vz to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h to ip-10-0-138-109.ec2.internal

openshift-ingress

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz to ip-10-0-138-163.ec2.internal

openshift-ingress

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c17951b0-openshift-default-d64755cfb-gk565 to ip-10-0-138-163.ec2.internal

openshift-ingress

kube-auth-proxy-694bf5b6d6-mvv4m

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-694bf5b6d6-mvv4m to ip-10-0-138-109.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-64tt4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-64tt4 to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl to ip-10-0-138-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv to ip-10-0-132-10.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz to ip-10-0-132-10.ec2.internal

openshift-ingress

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx to ip-10-0-138-163.ec2.internal

openshift-ingress

router-default-5b79d74577-h8slk

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

router-default-5b79d74577-h8slk

Scheduled

Successfully assigned openshift-ingress/router-default-5b79d74577-h8slk to ip-10-0-138-163.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5b79d74577 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-5b79d74577

FailedCreate

Error creating: pods "router-default-5b79d74577-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-5b79d74577

FailedCreate

Error creating: pods "router-default-5b79d74577-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5b79d74577

SuccessfulCreate

Created pod: router-default-5b79d74577-h8slk
(x6)

openshift-ingress

kubelet

router-default-5b79d74577-h8slk

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-5b79d74577-h8slk

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5b79d74577-h8slk

Started

Started container router

openshift-ingress

multus

router-default-5b79d74577-h8slk

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5b79d74577-h8slk

Created

Created container: router

openshift-ingress

kubelet

router-default-5b79d74577-h8slk

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-694bf5b6d6 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-694bf5b6d6

FailedCreate

Error creating: pods "kube-auth-proxy-694bf5b6d6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-694bf5b6d6

SuccessfulCreate

Created pod: kube-auth-proxy-694bf5b6d6-f64vz

openshift-ingress

multus

kube-auth-proxy-694bf5b6d6-f64vz

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-f64vz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-694bf5b6d6

SuccessfulCreate

Created pod: kube-auth-proxy-694bf5b6d6-mvv4m

openshift-ingress

multus

kube-auth-proxy-694bf5b6d6-mvv4m

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-mvv4m

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-klmb9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-f64vz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.741s (2.741s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-mvv4m

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-mvv4m

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-mvv4m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.722s (2.722s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-klmb9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-f64vz

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-694bf5b6d6-f64vz

Created

Created container: kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-klmb9

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-klmb9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-klmb9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-klmb9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.615s (2.615s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-klmb9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-klmb9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.582s (3.582s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rx9js

Started

Started container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-596h4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-596h4

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-64tt4

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-pnh69
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pnh69

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-64tt4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-64tt4

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5cc6cd444b-pnh69

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-64tt4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-64tt4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pnh69

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pnh69

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-64tt4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.816s (2.816s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-pnh69

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.779s (2.779s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-596h4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-596h4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-596h4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-596h4

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-596h4

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-ait-2b3f0867

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-2b3f0867-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-2b3f0867-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-2b3f0867

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2b3f0867

openshift-ingress

deployment-controller

e2e-ait-2b3f0867-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2b3f0867-openshift-default-6c4bd74488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-2b3f0867-openshift-default-6c4bd74488

SuccessfulCreate

Created pod: e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

openshift-ingress

multus

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

openshift-ingress

multus

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b3f0867: serviceaccount "payload-processing-e2e-ait-2b3f0867" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2b3f0867

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2b3f0867

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2b3f0867-54c4bc47fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b3f0867-54c4bc47fb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2b3f0867-54c4bc47fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b3f0867: serviceaccount "payload-processing-e2e-ait-2b3f0867" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b3f0867-54c4bc47fb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p
(x2)

openshift-ingress

kubelet

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-2b3f0867-54c4bc47fb-bzq2p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b3f0867-6fdc9667f6-s9fjk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-2b3f0867-openshift-default-6c4bd74488-hpp2l

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-28d9404a-gw-openshift-default-d478b57b

SuccessfulCreate

Created pod: e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

openshift-ingress

deployment-controller

e2e-migrate-28d9404a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-28d9404a-gw-openshift-default-d478b57b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-28d9404a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-28d9404a-gw

openshift-ingress

multus

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-28d9404a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-28d9404a-d8c58b79c

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-28d9404a-d8c58b79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-28d9404a: serviceaccount "payload-processing-e2e-migrate-28d9404a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-28d9404a-d8c58b79c

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-28d9404a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-28d9404a-d8c58b79c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-28d9404a: serviceaccount "payload-processing-e2e-migrate-28d9404a" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-28d9404a-d8c58b79c-f5vpb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-28d9404a-744b9c6c6d-sww84

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-9823a2a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9823a2a6-openshift-default-f94df46d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-9823a2a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9823a2a6

openshift-ingress

kubelet

e2e-migrate-28d9404a-gw-openshift-default-d478b57b-zfxcf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-9823a2a6-openshift-default-f94df46d8

SuccessfulCreate

Created pod: e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

openshift-ingress

multus

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9823a2a6: serviceaccount "payload-processing-e2e-ait-9823a2a6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9823a2a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9823a2a6-57cd587796 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9823a2a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9823a2a6-5bd58f7bcb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9823a2a6-57cd587796

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9823a2a6-57cd587796-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9823a2a6: serviceaccount "payload-processing-e2e-ait-9823a2a6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9823a2a6-57cd587796

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

openshift-ingress

multus

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9823a2a6-57cd587796-tbllh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9823a2a6-5bd58f7bcb-kvjnf

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-derive-c17951b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c17951b0-openshift-default-d64755cfb from 0 to 1

openshift-ingress

kubelet

e2e-ait-9823a2a6-openshift-default-f94df46d8-689nx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-c17951b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c17951b0

openshift-ingress

replicaset-controller

e2e-derive-c17951b0-openshift-default-d64755cfb

SuccessfulCreate

Created pod: e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

openshift-ingress

multus

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c17951b0-6bd4467b6b

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c17951b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c17951b0-6bd4467b6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c17951b0-6bd4467b6b

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c17951b0-6bd4467b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c17951b0: serviceaccount "payload-processing-e2e-derive-c17951b0" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c17951b0: serviceaccount "payload-processing-e2e-derive-c17951b0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c17951b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-c17951b0-6bd4467b6b-cfs6j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c17951b0-79cdf7dc56-9544m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-c17951b0-openshift-default-d64755cfb-gk565

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-7827eee1-openshift-default-679fcc4d84

SuccessfulCreate

Created pod: e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

openshift-ingress

gateway_labeler_controller

e2e-mt-7827eee1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7827eee1

openshift-ingress

deployment-controller

e2e-mt-7827eee1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7827eee1-openshift-default-679fcc4d84 from 0 to 1

openshift-ingress

multus

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7827eee1-5b77445fd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7827eee1-5b77445fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7827eee1: serviceaccount "payload-processing-e2e-mt-7827eee1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7827eee1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7827eee1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7827eee1-5b77445fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7827eee1: serviceaccount "payload-processing-e2e-mt-7827eee1" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7827eee1-5b77445fd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

Unhealthy

Readiness probe failed: dial tcp 10.133.0.51:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7827eee1-7f4bc6694d-f4fqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7827eee1-5b77445fd-6bdpk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7827eee1-openshift-default-679fcc4d84-m7hbx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-1a44779b-openshift-default-86db955c64

SuccessfulCreate

Created pod: e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

openshift-ingress

gateway_labeler_controller

e2e-mt-1a44779b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1a44779b

openshift-ingress

deployment-controller

e2e-mt-1a44779b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1a44779b-openshift-default-86db955c64 from 0 to 1

openshift-ingress

multus

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a44779b-979f499b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1a44779b-979f499b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a44779b: serviceaccount "payload-processing-e2e-mt-1a44779b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1a44779b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1a44779b-65dfdd9f9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a44779b-979f499b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a44779b-65dfdd9f9d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1a44779b-65dfdd9f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a44779b: serviceaccount "payload-processing-e2e-mt-1a44779b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1a44779b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1a44779b-979f499b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a44779b-65dfdd9f9d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a44779b-979f499b-d2rvz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a44779b-65dfdd9f9d-p4ltg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-1a44779b-openshift-default-86db955c64-xc8l6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-7c7176-openshift-default-568d6865b8

SuccessfulCreate

Created pod: e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

openshift-ingress

deployment-controller

e2e-inf-a-7c7176-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7c7176-openshift-default-568d6865b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7c7176

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7c7176

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7c7176

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7c7176-b46cdc77b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7c7176-b46cdc77b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7c7176-b46cdc77b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7c7176: serviceaccount "payload-processing-e2e-inf-a-7c7176" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7c7176: serviceaccount "payload-processing-e2e-inf-a-7c7176" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7c7176

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7c7176-b46cdc77b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-959cca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-959cca-openshift-default-586f57c5c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-959cca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-959cca

openshift-ingress

replicaset-controller

e2e-inf-b-959cca-openshift-default-586f57c5c6

SuccessfulCreate

Created pod: e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

openshift-ingress

multus

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-959cca-69654757c6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-959cca-69654757c6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-959cca: serviceaccount "payload-processing-e2e-inf-b-959cca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-959cca-69654757c6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-959cca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-959cca-69654757c6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-959cca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-959cca-f974cdff6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-959cca-f974cdff6

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-959cca-f974cdff6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-959cca: serviceaccount "payload-processing-e2e-inf-b-959cca" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-959cca-f974cdff6

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:58770->10.132.0.64:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:58770->10.132.0.64:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7c7176-b4585b9cb-jwhhv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7c7176-b46cdc77b-tddzq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-7c7176-openshift-default-568d6865b8-m9qkz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-959cca-69654757c6-cqkhp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-959cca-f974cdff6-9ch5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-4b0d96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4b0d96

openshift-ingress

deployment-controller

e2e-api-a-4b0d96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4b0d96-openshift-default-5d8cc86f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-4b0d96-openshift-default-5d8cc86f8

SuccessfulCreate

Created pod: e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

openshift-ingress

multus

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-959cca-openshift-default-586f57c5c6-7v96k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4b0d96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4b0d96-6ddd4c79cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4b0d96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4b0d96: serviceaccount "payload-processing-e2e-api-a-4b0d96" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4b0d96: serviceaccount "payload-processing-e2e-api-a-4b0d96" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-7cc89d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7cc89d

openshift-ingress

replicaset-controller

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb

SuccessfulCreate

Created pod: e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

openshift-ingress

deployment-controller

e2e-api-b-7cc89d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7cc89d-57fbb849f4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7cc89d-57fbb849f4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7cc89d-57fbb849f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7cc89d: serviceaccount "payload-processing-e2e-api-b-7cc89d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7cc89d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7cc89d-57fbb849f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7cc89d: serviceaccount "payload-processing-e2e-api-b-7cc89d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7cc89d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4b0d96-8654dd44bd-bl8pf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4b0d96-6ddd4c79cd-p5jkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-4b0d96-openshift-default-5d8cc86f8-v8b4l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7cc89d-55bc6fb564-bmw49

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7cc89d-57fbb849f4-f8d9x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-7cc89d-openshift-default-6d7c4cf8bb-ckxhl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-aadfb2-openshift-default-76db5f76c6

SuccessfulCreate

Created pod: e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

openshift-ingress

deployment-controller

e2e-shared-a-aadfb2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-aadfb2-openshift-default-76db5f76c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-aadfb2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-aadfb2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-aadfb2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-aadfb2-c88cd7b78

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-aadfb2-c88cd7b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-aadfb2: serviceaccount "payload-processing-e2e-shared-a-aadfb2" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-aadfb2: serviceaccount "payload-processing-e2e-shared-a-aadfb2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

openshift-ingress

kubelet

payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-aadfb2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-aadfb2-c88cd7b78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-aadfb2-c88cd7b78

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

openshift-ingress

kubelet

payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

Started

Started container payload-processing

openshift-ingress

multus

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-e0208c-openshift-default-745b9f8964

SuccessfulCreate

Created pod: e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

openshift-ingress

deployment-controller

e2e-shared-b-e0208c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-e0208c-openshift-default-745b9f8964 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-e0208c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-e0208c

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-e0208c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-e0208c-6f687c646d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-e0208c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-e0208c-5476cd5f94 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-e0208c-5476cd5f94

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-e0208c: serviceaccount "payload-processing-e2e-shared-b-e0208c" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-e0208c-5476cd5f94

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-e0208c-5476cd5f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-e0208c: serviceaccount "payload-processing-e2e-shared-b-e0208c" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-a-10e721-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-10e721-openshift-default-cbb9784bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-10e721

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-10e721

openshift-ingress

replicaset-controller

e2e-ipp-a-10e721-openshift-default-cbb9784bb

SuccessfulCreate

Created pod: e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

openshift-ingress

multus

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-10e721-59547d45d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-10e721-59547d45d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-10e721: serviceaccount "payload-processing-e2e-ipp-a-10e721" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-10e721

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-10e721

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-10e721-59547d45d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-10e721-59547d45d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-10e721: serviceaccount "payload-processing-e2e-ipp-a-10e721" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd

SuccessfulCreate

Created pod: e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

openshift-ingress

deployment-controller

e2e-ipp-b-8c3dba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8c3dba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8c3dba

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x4)

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.766s (2.766s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8c3dba: serviceaccount "payload-processing-e2e-ipp-b-8c3dba" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8c3dba-79c444c74

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8c3dba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8c3dba-79c444c74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8c3dba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8c3dba-79c444c74

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8c3dba-79c444c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8c3dba: serviceaccount "payload-processing-e2e-ipp-b-8c3dba" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.569s (1.569s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": read tcp 10.134.0.2:59894->10.134.0.47:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": read tcp 10.134.0.2:59894->10.134.0.47:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-eb0742

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-eb0742

openshift-ingress

multus

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-eb0742-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eb0742: serviceaccount "payload-processing-e2e-ipp-cleanup-eb0742" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-eb0742

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eb0742: serviceaccount "payload-processing-e2e-ipp-cleanup-eb0742" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-eb0742

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb0742-687657c7fb-tktg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb0742-7c75c67776-4lssq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-eb0742-openshift-default-5f8f5546b4-w77b6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10e721-5cbfc458d-t8zb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10e721-59547d45d-dv5qt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-10e721-openshift-default-cbb9784bb-94qgh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8c3dba-79c444c74-6lzkp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8c3dba-6bd5d6d7dd-xl7kg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8c3dba-openshift-default-649cd6f8fd-hhm6h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-aadfb2-c88cd7b78-lqkkj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-aadfb2-5cb4dcdcf6-zc266

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-aadfb2-openshift-default-76db5f76c6-kc7m7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-e0208c-6f687c646d-f74k9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-e0208c-5476cd5f94-w678n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-e0208c-openshift-default-745b9f8964-jphn4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503