Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-579d8dfb47-nh8bj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-579d8dfb47-nh8bj to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ait-edc4df58-69749b846-jtgkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-edc4df58-69749b846-jtgkf to ip-10-0-133-160.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj to ip-10-0-128-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-jkqdq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-jkqdq to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp to ip-10-0-133-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-zvf29

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zvf29 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6 to ip-10-0-133-160.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9 to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7 to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-117350-openshift-default-bc5c78698-2q26k to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-tnwkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-tnwkf to ip-10-0-128-236.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-sxr8f

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sxr8f to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-ltr2d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-ltr2d to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-711431-74cf598646-vml2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-711431-74cf598646-vml2r to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d to ip-10-0-133-160.ec2.internal

openshift-ingress

kube-auth-proxy-579d8dfb47-bbhf8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-579d8dfb47-bbhf8 to ip-10-0-134-138.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6 to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br to ip-10-0-128-236.ec2.internal

openshift-ingress

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Scheduled

Successfully assigned openshift-ingress/e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk to ip-10-0-128-236.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7 to ip-10-0-133-160.ec2.internal

openshift-ingress

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-711431-openshift-default-6bc756c986-w6d6v to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8 to ip-10-0-133-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-117350-86d66796bb-2r96v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-117350-86d66796bb-2r96v to ip-10-0-133-160.ec2.internal

openshift-ingress

router-default-86b574f647-594xn

Scheduled

Successfully assigned openshift-ingress/router-default-86b574f647-594xn to ip-10-0-133-160.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-86b574f647 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-86b574f647

FailedCreate

Error creating: pods "router-default-86b574f647-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-86b574f647

FailedCreate

Error creating: pods "router-default-86b574f647-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-86b574f647

SuccessfulCreate

Created pod: router-default-86b574f647-594xn
(x6)

openshift-ingress

kubelet

router-default-86b574f647-594xn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-86b574f647-594xn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-86b574f647-594xn

Started

Started container router

openshift-ingress

kubelet

router-default-86b574f647-594xn

Created

Created container: router

openshift-ingress

kubelet

router-default-86b574f647-594xn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-86b574f647-594xn

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-579d8dfb47

FailedCreate

Error creating: pods "kube-auth-proxy-579d8dfb47-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-bbhf8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-579d8dfb47 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-579d8dfb47

SuccessfulCreate

Created pod: kube-auth-proxy-579d8dfb47-bbhf8

openshift-ingress

replicaset-controller

kube-auth-proxy-579d8dfb47

SuccessfulCreate

Created pod: kube-auth-proxy-579d8dfb47-nh8bj

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-nh8bj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-579d8dfb47-bbhf8

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-579d8dfb47-nh8bj

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-sxr8f

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-sxr8f

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxr8f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-bbhf8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-bbhf8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.642s (2.642s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-bbhf8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-nh8bj

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-nh8bj

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-579d8dfb47-nh8bj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.602s (4.602s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxr8f

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxr8f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.484s (4.484s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxr8f

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-jkqdq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jkqdq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-jkqdq

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jkqdq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.18s (3.18s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jkqdq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jkqdq

Created

Created container: discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jkqdq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.465s (3.465s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqc2f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.369s (3.369s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jkqdq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-sxr8f

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sxr8f

Killing

Stopping container discovery
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

ProbeError

Startup probe error: Get "http://10.133.0.21:15021/healthz/ready": dial tcp 10.133.0.21:15021: connect: connection refused body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Unhealthy

Startup probe failed: Get "http://10.133.0.21:15021/healthz/ready": dial tcp 10.133.0.21:15021: connect: connection refused

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc4gdk4

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-zvf29

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-zvf29

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

multus

payload-processing-5cc6cd444b-tnwkf

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-tnwkf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-ltr2d

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-ltr2d

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-tnwkf

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-ltr2d

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-ltr2d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.282s (2.282s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-tnwkf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.321s (2.321s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-tnwkf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-ltr2d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-ltr2d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-tnwkf

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zvf29

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zvf29

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zvf29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zvf29

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-zvf29

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-0603e8fc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0603e8fc

openshift-ingress

multus

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-ait-0603e8fc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0603e8fc-openshift-default-fff856cc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0603e8fc-openshift-default-fff856cc4

SuccessfulCreate

Created pod: e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.43s (4.43s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0603e8fc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0603e8fc-859467d7d4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0603e8fc-7bf7b468fd

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0603e8fc-7bf7b468fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0603e8fc: serviceaccount "payload-processing-e2e-ait-0603e8fc" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0603e8fc: serviceaccount "payload-processing-e2e-ait-0603e8fc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0603e8fc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0603e8fc-7bf7b468fd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0603e8fc-7bf7b468fd

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

openshift-ingress

kubelet

payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

openshift-ingress

multus

payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.109s (2.109s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-0603e8fc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-0603e8fc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-0603e8fc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-0603e8fc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4038acb1-1612-470c-8c6e-66602ff4834c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0603e8fc-859467d7d4-gpsmt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0603e8fc-7bf7b468fd-bwkkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-916f7ae5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-916f7ae5-gw-openshift-default-7749888f68 from 0 to 1

openshift-ingress

multus

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ait-0603e8fc-openshift-default-fff856cc4-5p7dt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68

SuccessfulCreate

Created pod: e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

openshift-ingress

gateway_labeler_controller

e2e-migrate-916f7ae5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-916f7ae5-gw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-916f7ae5-97597d8fc

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-916f7ae5-97597d8fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-916f7ae5: serviceaccount "payload-processing-e2e-migrate-916f7ae5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-916f7ae5: serviceaccount "payload-processing-e2e-migrate-916f7ae5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-916f7ae5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-916f7ae5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-916f7ae5-97597d8fc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-916f7ae5-97597d8fc

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-916f7ae5-97597d8fc-lv69b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-916f7ae5-68bcf4cfc6-thlq7

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-edc4df58-openshift-default-dcbf466b

SuccessfulCreate

Created pod: e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

openshift-ingress

deployment-controller

e2e-ait-edc4df58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-edc4df58-openshift-default-dcbf466b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-edc4df58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-edc4df58

openshift-ingress

multus

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-edc4df58-69749b846-jtgkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ait-edc4df58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-edc4df58-69749b846 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-edc4df58-69749b846

SuccessfulCreate

Created pod: payload-processing-e2e-ait-edc4df58-69749b846-jtgkf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-edc4df58-69749b846

FailedCreate

Error creating: pods "payload-processing-e2e-ait-edc4df58-69749b846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-edc4df58: serviceaccount "payload-processing-e2e-ait-edc4df58" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-916f7ae5-gw-openshift-default-7749888f68-v96sj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-edc4df58: serviceaccount "payload-processing-e2e-ait-edc4df58" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-edc4df58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-edc4df58-69749b846-jtgkf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-edc4df58-69749b846-jtgkf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-edc4df58-69749b846-jtgkf

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

Unhealthy

Readiness probe failed: dial tcp 10.132.0.49:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

ProbeError

Readiness probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Unhealthy

Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-edc4df58-69749b846-jtgkf

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-edc4df58

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-edc4df58: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-edc4df58": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-edc4df58, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0e974c34-4b80-4b15-9a28-4646c1a6c5f0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-edc4df58-57f74ff6cb-jckg6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-10cc1978-openshift-default-888dc9d44

SuccessfulCreate

Created pod: e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

openshift-ingress

gateway_labeler_controller

e2e-derive-10cc1978

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-10cc1978

openshift-ingress

deployment-controller

e2e-derive-10cc1978-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-10cc1978-openshift-default-888dc9d44 from 0 to 1

openshift-ingress

multus

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-edc4df58-openshift-default-dcbf466b-xshdf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-10cc1978-785cfd648

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-10cc1978-6495f49858

FailedCreate

Error creating: pods "payload-processing-e2e-derive-10cc1978-6495f49858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-10cc1978: serviceaccount "payload-processing-e2e-derive-10cc1978" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-10cc1978

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-10cc1978-785cfd648 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-10cc1978-785cfd648

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-10cc1978-785cfd648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-10cc1978: serviceaccount "payload-processing-e2e-derive-10cc1978" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-10cc1978

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-10cc1978-6495f49858 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-10cc1978-6495f49858

SuccessfulCreate

Created pod: payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

openshift-ingress

kubelet

payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-10cc1978-6495f49858-mzlzk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-10cc1978-785cfd648-2kbgb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-10cc1978-openshift-default-888dc9d44-dqmsh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-6e5ce9cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6e5ce9cb

openshift-ingress

deployment-controller

e2e-mt-6e5ce9cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6e5ce9cb-openshift-default-6664476dbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6e5ce9cb-openshift-default-6664476dbd

SuccessfulCreate

Created pod: e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

openshift-ingress

multus

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6e5ce9cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6e5ce9cb: serviceaccount "payload-processing-e2e-mt-6e5ce9cb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6e5ce9cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6e5ce9cb-649c7fccc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6e5ce9cb: serviceaccount "payload-processing-e2e-mt-6e5ce9cb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

openshift-ingress

multus

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6e5ce9cb-56478cb56d-2g6dd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6e5ce9cb-649c7fccc4-b2hsw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-6e5ce9cb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-6e5ce9cb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-6e5ce9cb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-6e5ce9cb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ef048d1d-d36e-4171-9798-13355f12f402, UID in object meta:

openshift-ingress

kubelet

e2e-mt-6e5ce9cb-openshift-default-6664476dbd-5b9z2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-3474a135

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3474a135

openshift-ingress

replicaset-controller

e2e-mt-3474a135-openshift-default-8b9f6b744

SuccessfulCreate

Created pod: e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

openshift-ingress

deployment-controller

e2e-mt-3474a135-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3474a135-openshift-default-8b9f6b744 from 0 to 1

openshift-ingress

multus

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3474a135

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3474a135-65f7f94fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3474a135-7b59f8668d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3474a135-7b59f8668d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3474a135: serviceaccount "payload-processing-e2e-mt-3474a135" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3474a135-65f7f94fd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3474a135-65f7f94fd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3474a135-65f7f94fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3474a135: serviceaccount "payload-processing-e2e-mt-3474a135" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3474a135

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3474a135-7b59f8668d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3474a135-7b59f8668d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

openshift-ingress

kubelet

payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Unhealthy

Readiness probe failed: dial tcp 10.132.0.61:9004: connect: connection refused

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:37296->10.132.0.59:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:37296->10.132.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Unhealthy

Liveness probe failed: dial tcp 10.132.0.61:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-3474a135-65f7f94fd-lvgng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3474a135-7b59f8668d-plwv2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-3474a135-openshift-default-8b9f6b744-vnfqp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6dd19d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6dd19d

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-6dd19d

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-6dd19d-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-6dd19d-authn-ssl" already exists

openshift-ingress

multus

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-6dd19d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6dd19d-openshift-default-5c4984bc9d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d

SuccessfulCreate

Created pod: e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6dd19d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6dd19d-649db466cb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6dd19d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6dd19d-5775679b6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6dd19d: serviceaccount "payload-processing-e2e-inf-a-6dd19d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6dd19d-5775679b6b

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6dd19d-5775679b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6dd19d: serviceaccount "payload-processing-e2e-inf-a-6dd19d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6dd19d-5775679b6b

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-117350

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-117350

openshift-ingress

deployment-controller

e2e-inf-b-117350-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-117350-openshift-default-bc5c78698 from 0 to 1

openshift-ingress

multus

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-117350-openshift-default-bc5c78698

SuccessfulCreate

Created pod: e2e-inf-b-117350-openshift-default-bc5c78698-2q26k
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-117350-86d66796bb

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-117350-86d66796bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-117350: serviceaccount "payload-processing-e2e-inf-b-117350" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-117350

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-117350-86d66796bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-117350

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-117350-57cc596788 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-117350-57cc596788

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-117350-57cc596788-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-117350: serviceaccount "payload-processing-e2e-inf-b-117350" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-117350-86d66796bb-2r96v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-117350-86d66796bb-2r96v

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-117350-86d66796bb-2r96v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-117350-57cc596788

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-117350-86d66796bb-2r96v

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-117350-86d66796bb

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-117350-86d66796bb-2r96v
(x2)

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6dd19d-649db466cb-lbvx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6dd19d-5775679b6b-56wt7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-6dd19d-openshift-default-5c4984bc9d-mqwlh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-117350-57cc596788-ckvbd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-117350-86d66796bb-2r96v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-711431-openshift-default-6bc756c986

SuccessfulCreate

Created pod: e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

openshift-ingress

gateway_labeler_controller

e2e-api-a-711431

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-711431

openshift-ingress

deployment-controller

e2e-api-a-711431-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-711431-openshift-default-6bc756c986 from 0 to 1

openshift-ingress

multus

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-117350-openshift-default-bc5c78698-2q26k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-711431-74cf598646

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-711431-74cf598646-vml2r

openshift-ingress

kubelet

payload-processing-e2e-api-a-711431-74cf598646-vml2r

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-711431

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-711431-5ddb54f4d8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-711431: serviceaccount "payload-processing-e2e-api-a-711431" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-711431

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-711431-74cf598646 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-711431-74cf598646

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-711431-74cf598646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-711431: serviceaccount "payload-processing-e2e-api-a-711431" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-711431-74cf598646-vml2r

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-711431-74cf598646-vml2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-711431-74cf598646-vml2r

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

ProbeError

Readiness probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Unhealthy

Readiness probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-f632f1-openshift-default-7857b57b4b

SuccessfulCreate

Created pod: e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

openshift-ingress

deployment-controller

e2e-api-b-f632f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f632f1-openshift-default-7857b57b4b from 0 to 1

openshift-ingress

multus

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-f632f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f632f1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f632f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f632f1-5fd4b6fd7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f632f1-99b598d4d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f632f1-99b598d4d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f632f1: serviceaccount "payload-processing-e2e-api-b-f632f1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f632f1: serviceaccount "payload-processing-e2e-api-b-f632f1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f632f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f632f1-99b598d4d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f632f1-99b598d4d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

openshift-ingress

multus

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-711431

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-711431: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-711431": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-711431, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e39ef1a7-cb46-4dd7-af64-22e59e3ae19c, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-711431-74cf598646-vml2r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-711431-5ddb54f4d8-cqf88

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-711431-openshift-default-6bc756c986-w6d6v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

Unhealthy

Readiness probe failed: dial tcp 10.132.0.76:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f632f1-99b598d4d-bmhg8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f632f1-5fd4b6fd7d-p7t6d

Unhealthy

Readiness probe failed: dial tcp 10.132.0.75:9004: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-f632f1-openshift-default-7857b57b4b-r7tdp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-ed54db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-ed54db

openshift-ingress

deployment-controller

e2e-shared-a-ed54db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-ed54db-openshift-default-769d867f5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-ed54db-openshift-default-769d867f5b

SuccessfulCreate

Created pod: e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

openshift-ingress

multus

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-ed54db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-ed54db: serviceaccount "payload-processing-e2e-shared-a-ed54db" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-ed54db-7847d48bf8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-ed54db-7847d48bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-ed54db: serviceaccount "payload-processing-e2e-shared-a-ed54db" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-ed54db-7847d48bf8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-ed54db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-ed54db-7847d48bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-1231ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-1231ba

openshift-ingress

multus

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-1231ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-1231ba-openshift-default-f66b89cfb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-1231ba-openshift-default-f66b89cfb

SuccessfulCreate

Created pod: e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-1231ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-1231ba-795f78959b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-1231ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-1231ba-7894d8877d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-1231ba-795f78959b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-1231ba-795f78959b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-1231ba: serviceaccount "payload-processing-e2e-shared-b-1231ba" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-1231ba-7894d8877d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-1231ba-7894d8877d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-1231ba-7894d8877d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-1231ba: serviceaccount "payload-processing-e2e-shared-b-1231ba" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-1231ba-795f78959b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-92ba10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-92ba10

openshift-ingress

replicaset-controller

e2e-ipp-a-92ba10-openshift-default-566b564dbd

SuccessfulCreate

Created pod: e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

openshift-ingress

deployment-controller

e2e-ipp-a-92ba10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-92ba10-openshift-default-566b564dbd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-92ba10-864b9fd7b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-92ba10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-92ba10-864b9fd7b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-92ba10-864b9fd7b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-92ba10: serviceaccount "payload-processing-e2e-ipp-a-92ba10" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-92ba10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-92ba10-864b9fd7b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-92ba10: serviceaccount "payload-processing-e2e-ipp-a-92ba10" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-37887f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-37887f

openshift-ingress

replicaset-controller

e2e-ipp-b-37887f-openshift-default-5588f6f4d6

SuccessfulCreate

Created pod: e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

openshift-ingress

deployment-controller

e2e-ipp-b-37887f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-37887f-openshift-default-5588f6f4d6 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-37887f-756bd49798

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-37887f-756bd49798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-37887f: serviceaccount "payload-processing-e2e-ipp-b-37887f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-37887f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-37887f-756bd49798

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-37887f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-37887f-756bd49798 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-37887f: serviceaccount "payload-processing-e2e-ipp-b-37887f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746

SuccessfulCreate

Created pod: e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-579f3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-579f3e

openshift-ingress

deployment-controller

e2e-ipp-cleanup-579f3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e: serviceaccount "payload-processing-e2e-ipp-cleanup-579f3e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-579f3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-579f3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-579f3e: serviceaccount "payload-processing-e2e-ipp-cleanup-579f3e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-579f3e-799cc7f5f6-gd8v9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-579f3e-7d8b8bf9db-nh7l6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-579f3e-openshift-default-76c58d7746-4lzpr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-92ba10-545bd876fb-5sfdj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-92ba10-864b9fd7b-ks4br

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-92ba10-openshift-default-566b564dbd-c9shk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-37887f-756bd49798-hmrfq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-37887f-787db5b4b4-4xbl4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-37887f-openshift-default-5588f6f4d6-n6t77

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-ed54db-7847d48bf8-7gfrt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-ed54db-6c55999b6d-vgppt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-ed54db-openshift-default-769d867f5b-l2vhj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-1231ba-7894d8877d-zvvb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-1231ba-795f78959b-528b6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-1231ba-openshift-default-f66b89cfb-qp9d4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503