Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94 to ip-10-0-131-63.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-mn8nv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-mn8nv to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7 to ip-10-0-131-63.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6zjr9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6zjr9 to ip-10-0-131-63.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cz94zk to ip-10-0-141-134.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns to ip-10-0-131-63.ec2.internal

openshift-ingress

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5 to ip-10-0-131-63.ec2.internal

openshift-ingress

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0c7d785d-openshift-default-576999f564-nktbw to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9 to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8 to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9 to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-8ddmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-8ddmv to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg to ip-10-0-131-63.ec2.internal

openshift-ingress

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Scheduled

Successfully assigned openshift-ingress/e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885 to ip-10-0-131-63.ec2.internal

openshift-ingress

kube-auth-proxy-6d7d7d465-8ctbx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6d7d7d465-8ctbx to ip-10-0-141-134.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq to ip-10-0-131-63.ec2.internal

openshift-ingress

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp to ip-10-0-141-134.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95 to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-dkr6m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-dkr6m to ip-10-0-131-63.ec2.internal

openshift-ingress

kube-auth-proxy-6d7d7d465-f2xmv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6d7d7d465-f2xmv to ip-10-0-131-63.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-hm8ww to ip-10-0-141-134.ec2.internal

openshift-ingress

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h to ip-10-0-142-133.ec2.internal

openshift-ingress

router-default-59f648499-fvcgf

Scheduled

Successfully assigned openshift-ingress/router-default-59f648499-fvcgf to ip-10-0-131-63.ec2.internal

openshift-ingress

router-default-59f648499-fvcgf

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-413844-74879c78c8-qm4km

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-413844-74879c78c8-qm4km to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-92df89-5694c5d774-zm222

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-92df89-5694c5d774-zm222 to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5 to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-413844-openshift-default-67766bf844-97tzq to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8 to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-820f12-cf68794d8-62r92 to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt to ip-10-0-142-133.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2 to ip-10-0-131-63.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t to ip-10-0-142-133.ec2.internal

openshift-ingress

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Scheduled

Successfully assigned openshift-ingress/e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl to ip-10-0-131-63.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-59f648499 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-59f648499

FailedCreate

Error creating: pods "router-default-59f648499-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-59f648499

FailedCreate

Error creating: pods "router-default-59f648499-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-59f648499

SuccessfulCreate

Created pod: router-default-59f648499-fvcgf
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-59f648499-fvcgf

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-59f648499-fvcgf

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-59f648499-fvcgf

Created

Created container: router

openshift-ingress

kubelet

router-default-59f648499-fvcgf

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-59f648499-fvcgf

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-59f648499-fvcgf

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-6d7d7d465

SuccessfulCreate

Created pod: kube-auth-proxy-6d7d7d465-8ctbx

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-f2xmv

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-8ctbx

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6d7d7d465

FailedCreate

Error creating: pods "kube-auth-proxy-6d7d7d465-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6d7d7d465

SuccessfulCreate

Created pod: kube-auth-proxy-6d7d7d465-f2xmv

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6d7d7d465 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-f2xmv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-8ctbx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6zjr9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-6d7d7d465-8ctbx

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6d7d7d465-f2xmv

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6zjr9

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-8ctbx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.343s (2.343s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-8ctbx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-8ctbx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-f2xmv

Created

Created container: kube-auth-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-mn8nv

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-f2xmv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.569s (3.569s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6d7d7d465-f2xmv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.058s (3.058s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-mn8nv

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mn8nv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mn8nv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mn8nv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mn8nv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.733s (3.733s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cz94zk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.161s (3.161s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mn8nv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mn8nv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6zjr9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

ProbeError

Readiness probe error: Get "http://10.132.0.29:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6zjr9

Unhealthy

Readiness probe failed: Get "http://10.132.0.29:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-hm8ww

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dkr6m

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-8ddmv

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8ddmv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-dkr6m

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-dkr6m

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-8ddmv

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dkr6m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dkr6m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.105s (2.105s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-dkr6m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8ddmv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8ddmv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-8ddmv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.063s (2.063s including waiting). Image size: 165907129 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-hm8ww

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-90db14c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-90db14c6

openshift-ingress

multus

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-90db14c6-openshift-default-54dbc56486

SuccessfulCreate

Created pod: e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-ait-90db14c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-90db14c6-openshift-default-54dbc56486 from 0 to 1

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.738s (2.738s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-90db14c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-90db14c6-868dd9cc7d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-90db14c6-77d446cd84

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-90db14c6-77d446cd84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-90db14c6: serviceaccount "payload-processing-e2e-ait-90db14c6" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-90db14c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-90db14c6-77d446cd84 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-90db14c6-77d446cd84

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-90db14c6-868dd9cc7d

SuccessfulCreate

Created pod: payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

openshift-ingress

kubelet

payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-90db14c6-868dd9cc7d

FailedCreate

Error creating: pods "payload-processing-e2e-ait-90db14c6-868dd9cc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-90db14c6: serviceaccount "payload-processing-e2e-ait-90db14c6" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-90db14c6-77d446cd84-j6c7h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-90db14c6-868dd9cc7d-pw9dt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-90db14c6-openshift-default-54dbc56486-9mrfs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-25f28971-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d from 0 to 1

openshift-ingress

multus

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-25f28971-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-25f28971-gw

openshift-ingress

replicaset-controller

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d

SuccessfulCreate

Created pod: e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-25f28971

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-25f28971-557d48bfb9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-25f28971-557d48bfb9

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-25f28971-557d48bfb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-25f28971: serviceaccount "payload-processing-e2e-migrate-25f28971" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-25f28971-557d48bfb9

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-25f28971

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-25f28971-54cb9f97b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-25f28971: serviceaccount "payload-processing-e2e-migrate-25f28971" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-25f28971-557d48bfb9-2w7cc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25f28971-54cb9f97b-fvzlc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-25f28971-gw-openshift-default-5d995f8b8d-xqptj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-0c7d785d-openshift-default-576999f564

SuccessfulCreate

Created pod: e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

openshift-ingress

gateway_labeler_controller

e2e-ait-0c7d785d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0c7d785d

openshift-ingress

deployment-controller

e2e-ait-0c7d785d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0c7d785d-openshift-default-576999f564 from 0 to 1

openshift-ingress

multus

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0c7d785d: serviceaccount "payload-processing-e2e-ait-0c7d785d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0c7d785d-78c7877d56

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0c7d785d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0c7d785d-78c7877d56 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0c7d785d-78c7877d56

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0c7d785d-78c7877d56-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0c7d785d: serviceaccount "payload-processing-e2e-ait-0c7d785d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0c7d785d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0c7d785d-848b6c7f5b-8pt7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0c7d785d-78c7877d56-k8bpw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-0c7d785d-openshift-default-576999f564-nktbw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4

SuccessfulCreate

Created pod: e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

openshift-ingress

deployment-controller

e2e-derive-9ffa79f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-9ffa79f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9ffa79f3

openshift-ingress

multus

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-9ffa79f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-9ffa79f3-7d879dbdb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6

SuccessfulCreate

Created pod: payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6

FailedCreate

Error creating: pods "payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9ffa79f3: serviceaccount "payload-processing-e2e-derive-9ffa79f3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9ffa79f3: serviceaccount "payload-processing-e2e-derive-9ffa79f3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-9ffa79f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:46058->10.132.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:46058->10.132.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-9ffa79f3-7d879dbdb6-bcfnt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9ffa79f3-666fb9f8d8-bqvrk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-9ffa79f3-openshift-default-7c8f7c9fd4-ht8gl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-438308e8-openshift-default-7c67f96dc6

SuccessfulCreate

Created pod: e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

openshift-ingress

multus

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-438308e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-438308e8-openshift-default-7c67f96dc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-438308e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-438308e8

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-438308e8: serviceaccount "payload-processing-e2e-mt-438308e8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-438308e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-438308e8-6d95f6d8c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-438308e8-6d95f6d8c4

SuccessfulCreate

Created pod: payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-438308e8-6d95f6d8c4

FailedCreate

Error creating: pods "payload-processing-e2e-mt-438308e8-6d95f6d8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-438308e8: serviceaccount "payload-processing-e2e-mt-438308e8" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-438308e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-438308e8-59ff75bb8d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

Unhealthy

Readiness probe failed: dial tcp 10.132.0.60:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-438308e8-6d95f6d8c4-c8cnd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-438308e8-59ff75bb8d-bnwnq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-438308e8-openshift-default-7c67f96dc6-g4jw5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-292ac4d2-openshift-default-56bc7d74b8

SuccessfulCreate

Created pod: e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

openshift-ingress

deployment-controller

e2e-mt-292ac4d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-292ac4d2-openshift-default-56bc7d74b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-292ac4d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-292ac4d2

openshift-ingress

multus

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-292ac4d2: serviceaccount "payload-processing-e2e-mt-292ac4d2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-292ac4d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-292ac4d2-7d6d9944bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-292ac4d2-7d6d9944bb

SuccessfulCreate

Created pod: payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-292ac4d2-7d6d9944bb

FailedCreate

Error creating: pods "payload-processing-e2e-mt-292ac4d2-7d6d9944bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-292ac4d2: serviceaccount "payload-processing-e2e-mt-292ac4d2" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-292ac4d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-292ac4d2-7d6d9944bb-zt7l5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-292ac4d2-ffdf5cb-xpdc8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-292ac4d2-openshift-default-56bc7d74b8-5j885

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-inf-a-820f12

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-820f12

openshift-ingress

multus

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-820f12-openshift-default-7f767497bd

SuccessfulCreate

Created pod: e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

openshift-ingress

deployment-controller

e2e-inf-a-820f12-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-820f12-openshift-default-7f767497bd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-820f12-745f95844d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-820f12-745f95844d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-820f12: serviceaccount "payload-processing-e2e-inf-a-820f12" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-820f12

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-820f12-745f95844d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-820f12

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-820f12-cf68794d8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-820f12-745f95844d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-820f12-cf68794d8

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-820f12-cf68794d8-62r92
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-820f12-cf68794d8

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-820f12-cf68794d8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-820f12: serviceaccount "payload-processing-e2e-inf-a-820f12" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-107131

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-107131

openshift-ingress

deployment-controller

e2e-inf-b-107131-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-107131-openshift-default-fcb7fc578 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-107131-openshift-default-fcb7fc578

SuccessfulCreate

Created pod: e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

openshift-ingress

multus

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-107131

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-107131-c947d85bd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-107131-c947d85bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-107131-c947d85bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-107131-c947d85bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-107131: serviceaccount "payload-processing-e2e-inf-b-107131" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-107131-6bbbcdb6fd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-107131-6bbbcdb6fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-107131: serviceaccount "payload-processing-e2e-inf-b-107131" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-107131-6bbbcdb6fd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-107131

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-107131-6bbbcdb6fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-820f12-745f95844d-pdj5h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

Unhealthy

Readiness probe failed: dial tcp 10.132.0.66:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-820f12-cf68794d8-62r92

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-820f12-openshift-default-7f767497bd-pq6bq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-107131-6bbbcdb6fd-ndbc8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-107131-c947d85bd-6qg95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-107131-openshift-default-fcb7fc578-6rdhb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-97aaee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-97aaee

openshift-ingress

deployment-controller

e2e-api-a-97aaee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-97aaee-openshift-default-6b996f64d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-97aaee-openshift-default-6b996f64d

SuccessfulCreate

Created pod: e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

openshift-ingress

multus

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-97aaee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-97aaee-ff695db96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-97aaee-ff695db96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-97aaee-ff695db96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-97aaee-ff695db96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-97aaee: serviceaccount "payload-processing-e2e-api-a-97aaee" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-97aaee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-97aaee-5f5d8858d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-97aaee-5f5d8858d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-97aaee-5f5d8858d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-97aaee-5f5d8858d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-97aaee: serviceaccount "payload-processing-e2e-api-a-97aaee" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-7d3cec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-7d3cec-openshift-default-7b55866fd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-7d3cec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-7d3cec

openshift-ingress

replicaset-controller

e2e-api-b-7d3cec-openshift-default-7b55866fd8

SuccessfulCreate

Created pod: e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

openshift-ingress

multus

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-7d3cec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-7d3cec-79477d979b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7d3cec-79477d979b

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-7d3cec-79477d979b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7d3cec: serviceaccount "payload-processing-e2e-api-b-7d3cec" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-7d3cec: serviceaccount "payload-processing-e2e-api-b-7d3cec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-7d3cec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-7d3cec-79477d979b

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-97aaee-5f5d8858d-dpm4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-97aaee-ff695db96-mpzst

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-97aaee-openshift-default-6b996f64d-jp27k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-7d3cec-79477d979b-75wn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-7d3cec-7d8cb7d49b-p7bns

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-92df89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-92df89-openshift-default-85c894fd84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-92df89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-92df89

openshift-ingress

replicaset-controller

e2e-shared-a-92df89-openshift-default-85c894fd84

SuccessfulCreate

Created pod: e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

openshift-ingress

multus

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-7d3cec-openshift-default-7b55866fd8-pmr94

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-92df89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-92df89-5694c5d774 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-92df89-5694c5d774

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-92df89-5694c5d774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-92df89: serviceaccount "payload-processing-e2e-shared-a-92df89" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-92df89-5694c5d774

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-92df89-5694c5d774-zm222
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-92df89: serviceaccount "payload-processing-e2e-shared-a-92df89" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-92df89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-92df89-7fd7485b8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-92df89-5694c5d774-zm222

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92df89-5694c5d774-zm222

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92df89-5694c5d774-zm222

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92df89-5694c5d774-zm222

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-413844

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-413844

openshift-ingress

deployment-controller

e2e-shared-b-413844-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-413844-openshift-default-67766bf844 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-413844-openshift-default-67766bf844

SuccessfulCreate

Created pod: e2e-shared-b-413844-openshift-default-67766bf844-97tzq

openshift-ingress

multus

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-413844-5748887b4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-413844

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-413844-5748887b4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-413844

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-413844-74879c78c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-413844-74879c78c8

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-413844-74879c78c8-qm4km
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-413844-5748887b4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-413844-5748887b4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-413844: serviceaccount "payload-processing-e2e-shared-b-413844" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-413844-74879c78c8

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-413844-74879c78c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-413844: serviceaccount "payload-processing-e2e-shared-b-413844" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-413844-74879c78c8-qm4km

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-413844-74879c78c8-qm4km

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-413844-74879c78c8-qm4km

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-413844-74879c78c8-qm4km

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-a-be7457-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-be7457-openshift-default-7c954c5ffd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-be7457

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-be7457

openshift-ingress

replicaset-controller

e2e-ipp-a-be7457-openshift-default-7c954c5ffd

SuccessfulCreate

Created pod: e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

openshift-ingress

multus

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-be7457

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-be7457-647cc885bd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-be7457-77f8c868fd

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-be7457-77f8c868fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-be7457: serviceaccount "payload-processing-e2e-ipp-a-be7457" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-be7457-77f8c868fd

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-be7457

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-be7457-77f8c868fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-be7457: serviceaccount "payload-processing-e2e-ipp-a-be7457" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-899559-openshift-default-865fc748b

SuccessfulCreate

Created pod: e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

openshift-ingress

deployment-controller

e2e-ipp-b-899559-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-899559-openshift-default-865fc748b from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-899559

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-899559-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-899559-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-899559

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-899559

openshift-ingress

multus

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-899559

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-899559-79ddbd9648 from 0 to 1
(x4)

openshift-ingress

kubelet

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-899559

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-899559-69bb66b758 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-899559-69bb66b758

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-899559-69bb66b758

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-899559-69bb66b758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-899559: serviceaccount "payload-processing-e2e-ipp-b-899559" not found
(x4)

openshift-ingress

kubelet

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-899559: serviceaccount "payload-processing-e2e-ipp-b-899559" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866

SuccessfulCreate

Created pod: e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-85930d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-85930d

openshift-ingress

deployment-controller

e2e-ipp-cleanup-85930d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-85930d: serviceaccount "payload-processing-e2e-ipp-cleanup-85930d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-85930d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-85930d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-85930d: serviceaccount "payload-processing-e2e-ipp-cleanup-85930d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-85930d-5fb4d7b596-6wxv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-85930d-dfdb86f4b-fcmsn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-85930d-openshift-default-6d6c65c866-25jhl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be7457-77f8c868fd-qrmvq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be7457-647cc885bd-nlcdw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-be7457-openshift-default-7c954c5ffd-lcsqg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-899559-79ddbd9648-dtwkh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-899559-69bb66b758-v8h2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-899559-openshift-default-865fc748b-7q9rp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-92df89-7fd7485b8-td6zk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-92df89-5694c5d774-zm222

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-92df89-openshift-default-85c894fd84-n4mj7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-413844-74879c78c8-qm4km

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-413844-5748887b4-dgzf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-413844-openshift-default-67766bf844-97tzq

Killing

Stopping container istio-proxy