Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95 to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm to ip-10-0-142-140.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-2r545

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-2r545 to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl to ip-10-0-138-110.ec2.internal

openshift-ingress

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5 to ip-10-0-142-140.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g to ip-10-0-142-140.ec2.internal

openshift-ingress

kube-auth-proxy-845c84c75b-q96jk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-845c84c75b-q96jk to ip-10-0-138-110.ec2.internal

openshift-ingress

kube-auth-proxy-845c84c75b-ttdw7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-845c84c75b-ttdw7 to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8 to ip-10-0-142-140.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4htkn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4htkn to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-bd7sz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-bd7sz to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf to ip-10-0-142-140.ec2.internal

openshift-ingress

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9 to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8 to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8 to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99 to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72 to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-lstfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-lstfn to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq to ip-10-0-142-140.ec2.internal

openshift-ingress

router-default-7646c97b6d-frnzn

Scheduled

Successfully assigned openshift-ingress/router-default-7646c97b6d-frnzn to ip-10-0-133-47.ec2.internal

openshift-ingress

router-default-7646c97b6d-frnzn

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5 to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-mt-65805bcc-5db76fd474-948lt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-65805bcc-5db76fd474-948lt to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv to ip-10-0-138-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5 to ip-10-0-138-110.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78 to ip-10-0-142-140.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s to ip-10-0-133-47.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9 to ip-10-0-133-47.ec2.internal

openshift-ingress

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk to ip-10-0-142-140.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7646c97b6d from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-7646c97b6d

FailedCreate

Error creating: pods "router-default-7646c97b6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7646c97b6d

FailedCreate

Error creating: pods "router-default-7646c97b6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-7646c97b6d

SuccessfulCreate

Created pod: router-default-7646c97b6d-frnzn
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-7646c97b6d-frnzn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7646c97b6d-frnzn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7646c97b6d-frnzn

Started

Started container router

openshift-ingress

kubelet

router-default-7646c97b6d-frnzn

Created

Created container: router

openshift-ingress

kubelet

router-default-7646c97b6d-frnzn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:627e54de31981702dfc5986fda8e14dd7490cc3ccfa94709d1b412defbb073bf" already present on machine

openshift-ingress

multus

router-default-7646c97b6d-frnzn

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-845c84c75b

SuccessfulCreate

Created pod: kube-auth-proxy-845c84c75b-q96jk
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-845c84c75b

FailedCreate

Error creating: pods "kube-auth-proxy-845c84c75b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-845c84c75b

SuccessfulCreate

Created pod: kube-auth-proxy-845c84c75b-ttdw7

openshift-ingress

multus

kube-auth-proxy-845c84c75b-ttdw7

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-845c84c75b from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-ttdw7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-q96jk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-845c84c75b-q96jk

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-2r545

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-2r545

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2r545

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-q96jk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.01s (4.01s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-q96jk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-q96jk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-ttdw7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.721s (4.721s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-ttdw7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-845c84c75b-ttdw7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2r545

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2r545

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.061s (3.061s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2r545

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2r545

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2r545

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.831s (2.831s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ndnrg

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4htkn

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4htkn

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-bd7sz

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bd7sz

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-lstfn

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-bd7sz

openshift-ingress

multus

payload-processing-5cc6cd444b-lstfn

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lstfn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lstfn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.689s (2.689s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bd7sz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lstfn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-lstfn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bd7sz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.727s (2.727s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-bd7sz

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4htkn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4htkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4htkn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4htkn

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4htkn

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-ait-77570ccf

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-77570ccf-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-77570ccf-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-ait-77570ccf-openshift-default-6d4d84d776

SuccessfulCreate

Created pod: e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

openshift-ingress

gateway_labeler_controller

e2e-ait-77570ccf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-77570ccf

openshift-ingress

deployment-controller

e2e-ait-77570ccf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-77570ccf-openshift-default-6d4d84d776 from 0 to 1

openshift-ingress

multus

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-77570ccf-5dc7667c84

FailedCreate

Error creating: pods "payload-processing-e2e-ait-77570ccf-5dc7667c84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-77570ccf: serviceaccount "payload-processing-e2e-ait-77570ccf" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-77570ccf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-77570ccf-5dc7667c84 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-77570ccf-5dc7667c84

SuccessfulCreate

Created pod: payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

openshift-ingress

multus

payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-77570ccf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-77570ccf: serviceaccount "payload-processing-e2e-ait-77570ccf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-77570ccf-68bf5f5bc6-lz4hl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-77570ccf-5dc7667c84-rjmjz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-51e95abc-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-51e95abc-gw-openshift-default-568878d5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-51e95abc-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-51e95abc-gw

openshift-ingress

replicaset-controller

e2e-migrate-51e95abc-gw-openshift-default-568878d5b

SuccessfulCreate

Created pod: e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

openshift-ingress

multus

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-77570ccf-openshift-default-6d4d84d776-rjjcf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-51e95abc-5f4c4b8657

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-51e95abc-5f4c4b8657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-51e95abc: serviceaccount "payload-processing-e2e-migrate-51e95abc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-51e95abc-5f4c4b8657

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-51e95abc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-51e95abc-5f4c4b8657 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-51e95abc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-51e95abc: serviceaccount "payload-processing-e2e-migrate-51e95abc" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-51e95abc-5f4c4b8657-tb4kq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-51e95abc-7bddc69cd4-zkjfn

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-4f378709

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4f378709

openshift-ingress

deployment-controller

e2e-ait-4f378709-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4f378709-openshift-default-54cc8f86b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-4f378709-openshift-default-54cc8f86b4

SuccessfulCreate

Created pod: e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

openshift-ingress

multus

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-51e95abc-gw-openshift-default-568878d5b-r2h5g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4f378709-58b59d99bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4f378709

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4f378709-68dfcdb8d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4f378709-68dfcdb8d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4f378709-68dfcdb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4f378709: serviceaccount "payload-processing-e2e-ait-4f378709" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4f378709-68dfcdb8d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4f378709-58b59d99bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4f378709-58b59d99bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4f378709: serviceaccount "payload-processing-e2e-ait-4f378709" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4f378709

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4f378709-58b59d99bd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4f378709-58b59d99bd-l5ntr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4f378709-68dfcdb8d-8xccv

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-fed81e80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-fed81e80

openshift-ingress

deployment-controller

e2e-derive-fed81e80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-fed81e80-openshift-default-f58979c44 from 0 to 1

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-fed81e80-openshift-default-f58979c44

SuccessfulCreate

Created pod: e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

openshift-ingress

multus

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-4f378709-openshift-default-54cc8f86b4-l98t5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-derive-fed81e80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-fed81e80-69df869b9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fed81e80-69df869b9d

FailedCreate

Error creating: pods "payload-processing-e2e-derive-fed81e80-69df869b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fed81e80: serviceaccount "payload-processing-e2e-derive-fed81e80" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-fed81e80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-fed81e80-7776bd5b44 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fed81e80-69df869b9d

SuccessfulCreate

Created pod: payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

openshift-ingress

multus

payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fed81e80: serviceaccount "payload-processing-e2e-derive-fed81e80" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

openshift-ingress

multus

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fed81e80-7776bd5b44-5s5qw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-fed81e80-69df869b9d-xt7hs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-fed81e80-openshift-default-f58979c44-wrwnk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-de4e0ed8-openshift-default-74748bff5b

SuccessfulCreate

Created pod: e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

openshift-ingress

multus

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-de4e0ed8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-de4e0ed8-openshift-default-74748bff5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-de4e0ed8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-de4e0ed8

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-de4e0ed8-799c8486f8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

openshift-ingress

multus

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-de4e0ed8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-de4e0ed8-799c8486f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-de4e0ed8-799c8486f8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-de4e0ed8-799c8486f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-de4e0ed8: serviceaccount "payload-processing-e2e-mt-de4e0ed8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-de4e0ed8: serviceaccount "payload-processing-e2e-mt-de4e0ed8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-de4e0ed8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-de4e0ed8-54dfb7dd64-9np7g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-de4e0ed8-799c8486f8-jp5dz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-de4e0ed8-openshift-default-74748bff5b-jcmdq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-65805bcc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-65805bcc-openshift-default-677c85d9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-65805bcc-openshift-default-677c85d9b

SuccessfulCreate

Created pod: e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

openshift-ingress

gateway_labeler_controller

e2e-mt-65805bcc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-65805bcc

openshift-ingress

multus

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-65805bcc: serviceaccount "payload-processing-e2e-mt-65805bcc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-65805bcc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-65805bcc-64445bdd7b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-65805bcc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-65805bcc-5db76fd474 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-65805bcc-5db76fd474

SuccessfulCreate

Created pod: payload-processing-e2e-mt-65805bcc-5db76fd474-948lt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-65805bcc-5db76fd474

FailedCreate

Error creating: pods "payload-processing-e2e-mt-65805bcc-5db76fd474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-65805bcc: serviceaccount "payload-processing-e2e-mt-65805bcc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-65805bcc-5db76fd474-948lt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-65805bcc-5db76fd474-948lt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-65805bcc-5db76fd474-948lt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-65805bcc-5db76fd474-948lt

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-65805bcc-5db76fd474-948lt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-65805bcc-64445bdd7b-tg72g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-65805bcc-openshift-default-677c85d9b-8zxsc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-a-7ca182-openshift-default-6c4555b6f4

SuccessfulCreate

Created pod: e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7ca182

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7ca182

openshift-ingress

deployment-controller

e2e-inf-a-7ca182-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7ca182-openshift-default-6c4555b6f4 from 0 to 1

openshift-ingress

multus

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7ca182-766b96f5fd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7ca182-766b96f5fd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7ca182-766b96f5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7ca182: serviceaccount "payload-processing-e2e-inf-a-7ca182" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7ca182-55b4546964

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7ca182

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7ca182-55b4546964 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7ca182-55b4546964

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7ca182-55b4546964-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7ca182: serviceaccount "payload-processing-e2e-inf-a-7ca182" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7ca182

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7ca182-766b96f5fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d7cee2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d7cee2

openshift-ingress

deployment-controller

e2e-inf-b-d7cee2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d7cee2-openshift-default-7988d98676 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-d7cee2-openshift-default-7988d98676

SuccessfulCreate

Created pod: e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

openshift-ingress

multus

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d7cee2-65467cf884

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d7cee2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d7cee2-65467cf884 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d7cee2-65467cf884

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d7cee2-65467cf884-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d7cee2: serviceaccount "payload-processing-e2e-inf-b-d7cee2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d7cee2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d7cee2-77c7977944 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d7cee2: serviceaccount "payload-processing-e2e-inf-b-d7cee2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7ca182-766b96f5fd-fl6rw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7ca182-55b4546964-qxvkr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-7ca182-openshift-default-6c4555b6f4-hzl72

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d7cee2-65467cf884-knptg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d7cee2-77c7977944-7szjr

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-a-deec1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-deec1a

openshift-ingress

replicaset-controller

e2e-api-a-deec1a-openshift-default-85684fc87d

SuccessfulCreate

Created pod: e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

openshift-ingress

kubelet

e2e-inf-b-d7cee2-openshift-default-7988d98676-qn5gf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-deec1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-deec1a-openshift-default-85684fc87d from 0 to 1

openshift-ingress

multus

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-deec1a: serviceaccount "payload-processing-e2e-api-a-deec1a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-deec1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-deec1a-5fcb9688cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-deec1a-5fcb9688cd

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-deec1a-5fcb9688cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-deec1a: serviceaccount "payload-processing-e2e-api-a-deec1a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-deec1a-5fcb9688cd

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-deec1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-deec1a-8bcd566cb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

openshift-ingress

kubelet

payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-9ffb05

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9ffb05

openshift-ingress

replicaset-controller

e2e-api-b-9ffb05-openshift-default-7855844b6

SuccessfulCreate

Created pod: e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

openshift-ingress

deployment-controller

e2e-api-b-9ffb05-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9ffb05-openshift-default-7855844b6 from 0 to 1

openshift-ingress

multus

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9ffb05

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9ffb05

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9ffb05-64b47d8cc4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9ffb05: serviceaccount "payload-processing-e2e-api-b-9ffb05" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9ffb05-64b47d8cc4

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9ffb05-64b47d8cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9ffb05: serviceaccount "payload-processing-e2e-api-b-9ffb05" not found

openshift-ingress

multus

payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9ffb05-64b47d8cc4

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

openshift-ingress

kubelet

payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-deec1a-8bcd566cb-78np9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-deec1a-5fcb9688cd-p24r9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-deec1a-openshift-default-85684fc87d-nlqxq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-9ffb05-64b47d8cc4-8q22s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9ffb05-7bf6594dd-ckbt8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9ffb05-openshift-default-7855844b6-4fh78

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-0fae8e-openshift-default-58b7f645d4

SuccessfulCreate

Created pod: e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

openshift-ingress

deployment-controller

e2e-shared-a-0fae8e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-0fae8e-openshift-default-58b7f645d4 from 0 to 1

openshift-ingress

multus

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-0fae8e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-0fae8e

openshift-ingress

multus

payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-0fae8e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-0fae8e-8bd69d798 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-0fae8e-8bd69d798

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-0fae8e-8bd69d798

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-0fae8e-8bd69d798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-0fae8e: serviceaccount "payload-processing-e2e-shared-a-0fae8e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-0fae8e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-0fae8e: serviceaccount "payload-processing-e2e-shared-a-0fae8e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-7055f0-openshift-default-7f887b656d

SuccessfulCreate

Created pod: e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

openshift-ingress

gateway_labeler_controller

e2e-shared-b-7055f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-7055f0

openshift-ingress

deployment-controller

e2e-shared-b-7055f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-7055f0-openshift-default-7f887b656d from 0 to 1

openshift-ingress

multus

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-7055f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-7055f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-7055f0-6dd798596 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-7055f0: serviceaccount "payload-processing-e2e-shared-b-7055f0" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-7055f0-6dd798596

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-7055f0-6dd798596

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-7055f0-6dd798596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-7055f0: serviceaccount "payload-processing-e2e-shared-b-7055f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb

SuccessfulCreate

Created pod: e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0e4b78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0e4b78

openshift-ingress

deployment-controller

e2e-ipp-a-0e4b78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb from 0 to 1

openshift-ingress

multus

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0e4b78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0e4b78: serviceaccount "payload-processing-e2e-ipp-a-0e4b78" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0e4b78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0e4b78-7f87f65494 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0e4b78-7f87f65494

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0e4b78-7f87f65494

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0e4b78-7f87f65494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0e4b78: serviceaccount "payload-processing-e2e-ipp-a-0e4b78" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-cf8ed9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-cf8ed9

openshift-ingress

deployment-controller

e2e-ipp-b-cf8ed9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd from 0 to 1

openshift-ingress

multus

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd

SuccessfulCreate

Created pod: e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-cf8ed9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cf8ed9: serviceaccount "payload-processing-e2e-ipp-b-cf8ed9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-cf8ed9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-cf8ed9: serviceaccount "payload-processing-e2e-ipp-b-cf8ed9" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.709s (2.709s including waiting). Image size: 165907127 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76

SuccessfulCreate

Created pod: e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-4df7e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-4df7e0

openshift-ingress

deployment-controller

e2e-ipp-cleanup-4df7e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-4df7e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4df7e0: serviceaccount "payload-processing-e2e-ipp-cleanup-4df7e0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-4df7e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4df7e0: serviceaccount "payload-processing-e2e-ipp-cleanup-4df7e0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

Unhealthy

Readiness probe failed: dial tcp 10.133.0.51:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": read tcp 10.134.0.2:45596->10.134.0.70:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": read tcp 10.134.0.2:45596->10.134.0.70:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-4df7e0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4df7e0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-4df7e0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4df7e0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f468bb4a-6d12-4f1f-b99d-b8b4cfa4f68a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4df7e0-7777cb6d84-hfzpv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4df7e0-557b67457b-kfxzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-4df7e0-openshift-default-666f646c76-f9qb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0e4b78-796c5d99cb-m2njz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0e4b78-7f87f65494-xv5vp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-0e4b78-openshift-default-7c5894cfdb-tzc2p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-cf8ed9-7d67bdb79d-45gv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-cf8ed9-5f4dd6557b-ggwhq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-cf8ed9-openshift-default-64bf9445cd-fqjvg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-0fae8e-8bd69d798-bnpd5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-0fae8e-f7d89477b-g6xg8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-0fae8e-openshift-default-58b7f645d4-m2f95

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-7055f0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-7055f0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-7055f0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-7055f0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 25e8df66-85ca-401d-8c58-4a271990a993, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7055f0-6dd798596-blx99

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7055f0-7b4c4c7b8b-zp6bm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-7055f0-openshift-default-7f887b656d-xhtpm

Killing

Stopping container istio-proxy