Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67 to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-z8d9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-z8d9v to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-t9h6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-t9h6w to ip-10-0-133-137.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6prf9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6prf9 to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8 to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd to ip-10-0-130-208.ec2.internal

openshift-ingress

kube-auth-proxy-7fbb59494c-kv8cx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7fbb59494c-kv8cx to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl to ip-10-0-130-223.ec2.internal

openshift-ingress

kube-auth-proxy-7fbb59494c-8wkbn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7fbb59494c-8wkbn to ip-10-0-130-208.ec2.internal

openshift-ingress

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2 to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-45956207-6869f475db-hrtr7 to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj to ip-10-0-130-208.ec2.internal

openshift-ingress

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf to ip-10-0-130-208.ec2.internal

openshift-ingress

router-default-6bf6bd4c64-ppwrg

Scheduled

Successfully assigned openshift-ingress/router-default-6bf6bd4c64-ppwrg to ip-10-0-133-137.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48 to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd to ip-10-0-133-137.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-wrzbn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wrzbn to ip-10-0-133-137.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-k589d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-k589d to ip-10-0-130-208.ec2.internal

openshift-ingress

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t to ip-10-0-130-208.ec2.internal

openshift-ingress

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2 to ip-10-0-133-137.ec2.internal

openshift-ingress

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7r97d

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7r97d to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl to ip-10-0-133-137.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-mx9mf

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-mx9mf to ip-10-0-130-223.ec2.internal

openshift-ingress

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64 to ip-10-0-130-208.ec2.internal

openshift-ingress

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf to ip-10-0-130-208.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68 to ip-10-0-130-223.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2 to ip-10-0-130-223.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6bf6bd4c64 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-6bf6bd4c64

FailedCreate

Error creating: pods "router-default-6bf6bd4c64-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6bf6bd4c64

FailedCreate

Error creating: pods "router-default-6bf6bd4c64-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6bf6bd4c64

SuccessfulCreate

Created pod: router-default-6bf6bd4c64-ppwrg
(x6)

openshift-ingress

kubelet

router-default-6bf6bd4c64-ppwrg

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6bf6bd4c64-ppwrg

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6bf6bd4c64-ppwrg

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-6bf6bd4c64-ppwrg

Started

Started container router

openshift-ingress

kubelet

router-default-6bf6bd4c64-ppwrg

Created

Created container: router

openshift-ingress

multus

router-default-6bf6bd4c64-ppwrg

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7fbb59494c

FailedCreate

Error creating: pods "kube-auth-proxy-7fbb59494c-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7fbb59494c

SuccessfulCreate

Created pod: kube-auth-proxy-7fbb59494c-kv8cx

openshift-ingress

replicaset-controller

kube-auth-proxy-7fbb59494c

SuccessfulCreate

Created pod: kube-auth-proxy-7fbb59494c-8wkbn

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7fbb59494c from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7fbb59494c-8wkbn

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-8wkbn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7fbb59494c-kv8cx

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-kv8cx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-wrzbn

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-wrzbn

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-kv8cx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.949s (2.949s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-8wkbn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.165s (3.165s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-8wkbn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-kv8cx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-8wkbn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7fbb59494c-kv8cx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.483s (2.483s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-j7c48

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.459s (2.459s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-k589d

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k589d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-k589d

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k589d

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k589d

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k589d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.217s (2.217s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wrzbn

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-wrzbn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6prf9

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6prf9

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7r97d

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7r97d

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-t9h6w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-t9h6w

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-t9h6w

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-7r97d

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-t9h6w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.323s (1.324s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-t9h6w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-t9h6w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7r97d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7r97d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7r97d

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.016s (3.016s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6prf9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6prf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6prf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6prf9

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6prf9

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-t9h6w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7r97d

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-z8d9v
(x4)

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

FailedCreate

Error creating: pods "payload-processing-85fd65c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-mx9mf

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1
(x3)

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

FailedCreate

Error creating: pods "payload-pre-processing-76f657cdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-z8d9v

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-76f657cdc4-z8d9v

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-85fd65c94c-mx9mf

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-85fd65c94c-mx9mf

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-z8d9v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-z8d9v

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.054s (1.054s including waiting). Image size: 141049839 bytes.

openshift-ingress

kubelet

payload-processing-85fd65c94c-mx9mf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.018s (1.018s including waiting). Image size: 141049839 bytes.

openshift-ingress

kubelet

payload-processing-85fd65c94c-mx9mf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-mx9mf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-z8d9v

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-998130

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-998130

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-9792ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-9792ff

openshift-ingress

deployment-controller

e2e-inf-a-a1f773-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a1f773-openshift-default-555dd7cf76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a1f773

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a1f773

openshift-ingress

replicaset-controller

e2e-inf-a-a1f773-openshift-default-555dd7cf76

SuccessfulCreate

Created pod: e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

openshift-ingress

replicaset-controller

e2e-worker-w0-998130-openshift-default-5f678668d8

SuccessfulCreate

Created pod: e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

openshift-ingress

deployment-controller

e2e-worker-w0-998130-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-998130-openshift-default-5f678668d8 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-a1f773

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-a1f773-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-a1f773-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-worker-w3-9792ff-openshift-default-7cb58c7848

SuccessfulCreate

Created pod: e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

openshift-ingress

deployment-controller

e2e-worker-w3-9792ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9792ff-openshift-default-7cb58c7848 from 0 to 1

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.815s (2.815s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a1f773

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a1f773-745c674775 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a1f773: serviceaccount "payload-processing-e2e-inf-a-a1f773" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a1f773-745c674775

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a1f773-745c674775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a1f773: serviceaccount "payload-processing-e2e-inf-a-a1f773" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a1f773

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a1f773-745c674775

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-998130

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-998130-b47cb667d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-998130-b47cb667d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-998130-b47cb667d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-998130: serviceaccount "payload-processing-e2e-worker-w0-998130" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-998130

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-998130-55bff55487 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-998130-55bff55487

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-998130-b47cb667d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-998130-55bff55487

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-998130-55bff55487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-998130: serviceaccount "payload-processing-e2e-worker-w0-998130" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9792ff: serviceaccount "payload-processing-e2e-worker-w3-9792ff" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-9792ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-9792ff-74f66fbbbc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9792ff: serviceaccount "payload-processing-e2e-worker-w3-9792ff" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-9792ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-ait-a8802cb2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a8802cb2-openshift-default-76859c6496 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-a8802cb2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a8802cb2

openshift-ingress

replicaset-controller

e2e-ait-a8802cb2-openshift-default-76859c6496

SuccessfulCreate

Created pod: e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

Started

Started container istio-proxy

openshift-ingress

multus

e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a8802cb2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a8802cb2-66f9b56d67 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a8802cb2: serviceaccount "payload-processing-e2e-ait-a8802cb2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a8802cb2-66f9b56d67

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a8802cb2-66f9b56d67

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a8802cb2-66f9b56d67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a8802cb2: serviceaccount "payload-processing-e2e-ait-a8802cb2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a8802cb2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a8802cb2-7b4859c94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-70c6df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-70c6df-openshift-default-6d5594fc8d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-70c6df-openshift-default-6d5594fc8d

SuccessfulCreate

Created pod: e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-70c6df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-70c6df

openshift-ingress

multus

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.621s (2.621s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-70c6df: serviceaccount "payload-processing-e2e-inf-b-70c6df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-70c6df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-70c6df-7ffffb4787

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-70c6df-7ffffb4787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-70c6df: serviceaccount "payload-processing-e2e-inf-b-70c6df" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-70c6df-7ffffb4787

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-70c6df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-70c6df-7ffffb4787 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a8802cb2-7b4859c94-g4rh5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-a8802cb2-openshift-default-76859c6496-cvb6z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-a8802cb2-66f9b56d67-drj68

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-45956207-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-45956207-gw

openshift-ingress

deployment-controller

e2e-migrate-45956207-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-45956207-gw-openshift-default-b57d5695b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-45956207-gw-openshift-default-b57d5695b

SuccessfulCreate

Created pod: e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

openshift-ingress

multus

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-45956207

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-45956207-59cb4c88b6 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-45956207

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-45956207-6869f475db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-45956207: serviceaccount "payload-processing-e2e-migrate-45956207" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-45956207-6869f475db

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-45956207-6869f475db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-45956207: serviceaccount "payload-processing-e2e-migrate-45956207" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-45956207-6869f475db

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk
(x5)

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-45956207-6869f475db-hrtr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-45956207-59cb4c88b6-t6vvk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-45956207-gw-openshift-default-b57d5695b-rjz79

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-d9680198

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d9680198

openshift-ingress

deployment-controller

e2e-ait-d9680198-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d9680198-openshift-default-579ff58d8b from 0 to 1

openshift-ingress

multus

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-d9680198-openshift-default-579ff58d8b

SuccessfulCreate

Created pod: e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d9680198: serviceaccount "payload-processing-e2e-ait-d9680198" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d9680198

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d9680198-7b8d545f97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d9680198-7b8d545f97

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d9680198-7b8d545f97

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d9680198-7b8d545f97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d9680198: serviceaccount "payload-processing-e2e-ait-d9680198" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d9680198

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

openshift-ingress

multus

payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-d9680198-7b8d545f97-8xlm2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d9680198-7dfbbfbcdb-jx6b2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-c9ad8682

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c9ad8682

openshift-ingress

replicaset-controller

e2e-derive-c9ad8682-openshift-default-6fd49694dd

SuccessfulCreate

Created pod: e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-derive-c9ad8682-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c9ad8682-openshift-default-6fd49694dd from 0 to 1

openshift-ingress

kubelet

e2e-ait-d9680198-openshift-default-579ff58d8b-lc24m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c9ad8682-6697557549

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c9ad8682-6697557549

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c9ad8682-6697557549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c9ad8682: serviceaccount "payload-processing-e2e-derive-c9ad8682" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c9ad8682

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c9ad8682-6697557549 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c9ad8682

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c9ad8682: serviceaccount "payload-processing-e2e-derive-c9ad8682" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c9ad8682-c69b5b85d-xlbwx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c9ad8682-6697557549-8jmxs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-c9ad8682-openshift-default-6fd49694dd-jzcps

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-a1f773

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-a1f773: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-a1f773": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-a1f773, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 55fd1caf-95be-4ffb-95ea-c50be9f657c6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a1f773-6685bf8cd-g52bb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a1f773-745c674775-6ksnz

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-f84020ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f84020ef

openshift-ingress

deployment-controller

e2e-mt-f84020ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f84020ef-openshift-default-569b5b6c96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-f84020ef-openshift-default-569b5b6c96

SuccessfulCreate

Created pod: e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

openshift-ingress

multus

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-a1f773-openshift-default-555dd7cf76-9qltf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f84020ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f84020ef-599f9b8977 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f84020ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f84020ef-6b788569b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f84020ef-599f9b8977

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f84020ef-599f9b8977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f84020ef: serviceaccount "payload-processing-e2e-mt-f84020ef" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f84020ef-6b788569b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f84020ef-599f9b8977

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f84020ef-6b788569b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f84020ef-6b788569b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f84020ef: serviceaccount "payload-processing-e2e-mt-f84020ef" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-70c6df-7ffffb4787-krmjd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-70c6df-77b4b5656b-cl5f2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-f14aba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b

SuccessfulCreate

Created pod: e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f14aba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f14aba

openshift-ingress

multus

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-70c6df-openshift-default-6d5594fc8d-5vh67

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f14aba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f14aba-588477f867

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f14aba-588477f867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f14aba: serviceaccount "payload-processing-e2e-shared-a-w2-f14aba" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f14aba-588477f867

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f14aba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f14aba-588477f867 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f14aba: serviceaccount "payload-processing-e2e-shared-a-w2-f14aba" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f84020ef-6b788569b6-qzx4s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f84020ef-599f9b8977-skmvl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-4e81aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4

SuccessfulCreate

Created pod: e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4e81aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4e81aa

openshift-ingress

multus

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f84020ef-openshift-default-569b5b6c96-4vzlq

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4e81aa: serviceaccount "payload-processing-e2e-shared-b-w2-4e81aa" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4e81aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4e81aa: serviceaccount "payload-processing-e2e-shared-b-w2-4e81aa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4e81aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-195881

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-195881

openshift-ingress

replicaset-controller

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76

SuccessfulCreate

Created pod: e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

openshift-ingress

deployment-controller

e2e-shared-a-w1-195881-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-195881-openshift-default-6c44bd8f76 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-195881: serviceaccount "payload-processing-e2e-shared-a-w1-195881" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-195881

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-195881-6f8744b875

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-195881-6f8744b875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-195881: serviceaccount "payload-processing-e2e-shared-a-w1-195881" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-195881

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-195881-6f8744b875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-195881-6f8744b875

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-b-w1-655d9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-655d9c-openshift-default-665fc78f94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94

SuccessfulCreate

Created pod: e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

openshift-ingress

multus

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-655d9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-655d9c
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-655d9c-55595775f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-655d9c-55595775f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-655d9c: serviceaccount "payload-processing-e2e-shared-b-w1-655d9c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-655d9c: serviceaccount "payload-processing-e2e-shared-b-w1-655d9c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-655d9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-655d9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-655d9c-55595775f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-655d9c-55595775f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-c56bfef6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c56bfef6
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-c56bfef6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c56bfef6-openshift-default-77d478d75b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-c56bfef6-openshift-default-77d478d75b

SuccessfulCreate

Created pod: e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

openshift-ingress

multus

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c56bfef6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c56bfef6-8bc99b845 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c56bfef6-8bc99b845

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c56bfef6-8bc99b845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c56bfef6: serviceaccount "payload-processing-e2e-mt-c56bfef6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c56bfef6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c56bfef6: serviceaccount "payload-processing-e2e-mt-c56bfef6" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c56bfef6-8bc99b845

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9792ff-5d886cb4c8-62nb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9792ff-74f66fbbbc-9tqqc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-9792ff-openshift-default-7cb58c7848-zkxbc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c56bfef6-7b7f4f69d6-7xh9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c56bfef6-8bc99b845-blhdj

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-c56bfef6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-c56bfef6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-c56bfef6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-c56bfef6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5a23efc2-3f4c-4a12-b4d6-a10845e79429, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-998130-b47cb667d-5pmzk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-998130-55bff55487-nb8x8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-998130-openshift-default-5f678668d8-vzs6t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-c56bfef6-openshift-default-77d478d75b-gbchv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-769e22-openshift-default-849f94c68b

SuccessfulCreate

Created pod: e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

openshift-ingress

multus

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-769e22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-769e22

openshift-ingress

deployment-controller

e2e-api-a-769e22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-769e22-openshift-default-849f94c68b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-769e22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-769e22-5d7dd68886 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-769e22-6dbfb89bf7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-769e22-6dbfb89bf7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-769e22-6dbfb89bf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-769e22: serviceaccount "payload-processing-e2e-api-a-769e22" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-769e22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-769e22-6dbfb89bf7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-769e22-5d7dd68886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-769e22-5d7dd68886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-769e22-5d7dd68886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-769e22: serviceaccount "payload-processing-e2e-api-a-769e22" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-dc538f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-dc538f-openshift-default-dff7f7c7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-dc538f-openshift-default-dff7f7c7b

SuccessfulCreate

Created pod: e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

openshift-ingress

gateway_labeler_controller

e2e-api-b-dc538f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-dc538f

openshift-ingress

multus

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dc538f: serviceaccount "payload-processing-e2e-api-b-dc538f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dc538f-7d59dc8559

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-dc538f-7d59dc8559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dc538f: serviceaccount "payload-processing-e2e-api-b-dc538f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dc538f-7d59dc8559

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-dc538f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-dc538f-7d59dc8559 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-dc538f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-769e22-6dbfb89bf7-fbbhr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-769e22-5d7dd68886-vs9xn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-769e22-openshift-default-849f94c68b-m8g6m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dc538f-c4f65d9f8-8q62b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-dc538f-7d59dc8559-w7ckl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-dc538f-openshift-default-dff7f7c7b-xr8gm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-195881-6596ccd5d-bwbz9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-195881-6f8744b875-f8226

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-195881-openshift-default-6c44bd8f76-zwzrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-655d9c-6c4c9cf9f4-982nl

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w1-655d9c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w1-655d9c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w1-655d9c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w1-655d9c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 09fa3c28-29a0-4629-8da9-ea526e4d7e5f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-655d9c-55595775f7-d7hfb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-655d9c-openshift-default-665fc78f94-2qvxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-90ebe5-openshift-default-897b7bd98

SuccessfulCreate

Created pod: e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-90ebe5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-90ebe5

openshift-ingress

deployment-controller

e2e-ipp-a-90ebe5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-90ebe5-openshift-default-897b7bd98 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-90ebe5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-90ebe5-6956684666 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-90ebe5: serviceaccount "payload-processing-e2e-ipp-a-90ebe5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-90ebe5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-90ebe5-5c674744df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-90ebe5-5c674744df

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-90ebe5-5c674744df

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-90ebe5-5c674744df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-90ebe5: serviceaccount "payload-processing-e2e-ipp-a-90ebe5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": read tcp 10.133.0.2:56580->10.133.0.73:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": read tcp 10.133.0.2:56580->10.133.0.73:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-e41875-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e41875-openshift-default-55796d58f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e41875

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e41875

openshift-ingress

replicaset-controller

e2e-ipp-b-e41875-openshift-default-55796d58f6

SuccessfulCreate

Created pod: e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e41875-64898f859f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e41875-64898f859f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e41875: serviceaccount "payload-processing-e2e-ipp-b-e41875" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e41875-64898f859f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e41875: serviceaccount "payload-processing-e2e-ipp-b-e41875" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e41875

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e41875-64898f859f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e41875

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

ProbeError

Readiness probe error: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Unhealthy

Readiness probe failed: Get "http://10.133.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

openshift-ingress

deployment-controller

e2e-ipp-cleanup-e2585e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-e2585e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-e2585e

openshift-ingress

multus

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e2585e: serviceaccount "payload-processing-e2e-ipp-cleanup-e2585e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e2585e: serviceaccount "payload-processing-e2e-ipp-cleanup-e2585e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-e2585e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-e2585e-65896fc759 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-e2585e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e2585e-6f47579dfd-8fqgx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e2585e-65896fc759-g28hb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-e2585e-openshift-default-56f89b75c6-nvntj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-90ebe5-6956684666-77x86

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-90ebe5-5c674744df-88ks8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-90ebe5-openshift-default-897b7bd98-2qtpf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e41875-64898f859f-7sd7s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e41875-7b6d844c4-9nqlw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-e41875-openshift-default-55796d58f6-jlffd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f14aba-588477f867-ds8rb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f14aba-768db85d-jpdft

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-f14aba-openshift-default-67db9c8b9b-tjf64

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4e81aa-7b84b5c6f5-nmn9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4e81aa-9587bd5f8-rcnkx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4e81aa-openshift-default-579787bfd4-tcflj

Killing

Stopping container istio-proxy