Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97 to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq to ip-10-0-139-137.ec2.internal

openshift-ingress

kube-auth-proxy-fcb5f7d79-gdwv2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-4wnbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4wnbl to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Scheduled

Successfully assigned openshift-ingress/e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm to ip-10-0-139-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5 to ip-10-0-139-137.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-cs5xt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk to ip-10-0-128-18.ec2.internal

openshift-ingress

router-default-55cd4498b4-c6wv9

Scheduled

Successfully assigned openshift-ingress/router-default-55cd4498b4-c6wv9 to ip-10-0-143-244.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4 to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq to ip-10-0-128-18.ec2.internal

openshift-ingress

kube-auth-proxy-fcb5f7d79-d492c

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-fcb5f7d79-d492c to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6 to ip-10-0-139-137.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-rqdkj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj to ip-10-0-143-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-k9cf4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-k9cf4 to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7 to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5 to ip-10-0-139-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9c1509-68f864477f-27wsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq to ip-10-0-143-244.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq to ip-10-0-139-137.ec2.internal

openshift-ingress

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn to ip-10-0-143-244.ec2.internal

openshift-ingress

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Scheduled

Successfully assigned openshift-ingress/e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw to ip-10-0-139-137.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c to ip-10-0-128-18.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg to ip-10-0-139-137.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4 to ip-10-0-128-18.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb to ip-10-0-128-18.ec2.internal

openshift-ingress

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 to ip-10-0-143-244.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-55cd4498b4 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-55cd4498b4

FailedCreate

Error creating: pods "router-default-55cd4498b4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-55cd4498b4

FailedCreate

Error creating: pods "router-default-55cd4498b4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-55cd4498b4

SuccessfulCreate

Created pod: router-default-55cd4498b4-c6wv9
(x5)

openshift-ingress

kubelet

router-default-55cd4498b4-c6wv9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-55cd4498b4-c6wv9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-55cd4498b4-c6wv9

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-55cd4498b4-c6wv9

Started

Started container router

openshift-ingress

kubelet

router-default-55cd4498b4-c6wv9

Created

Created container: router

openshift-ingress

multus

router-default-55cd4498b4-c6wv9

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-fcb5f7d79 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-fcb5f7d79

FailedCreate

Error creating: pods "kube-auth-proxy-fcb5f7d79-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-d492c

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-fcb5f7d79

SuccessfulCreate

Created pod: kube-auth-proxy-fcb5f7d79-d492c

openshift-ingress

replicaset-controller

kube-auth-proxy-fcb5f7d79

SuccessfulCreate

Created pod: kube-auth-proxy-fcb5f7d79-gdwv2

openshift-ingress

multus

kube-auth-proxy-fcb5f7d79-d492c

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-gdwv2

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-cs5xt

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-gdwv2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-fcb5f7d79-gdwv2

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-cs5xt

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-gdwv2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.682s (2.682s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-d492c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.121s (3.121s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-d492c

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-d492c

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-gdwv2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-fcb5f7d79-gdwv2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.65s (3.65s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.906s (2.906s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nn9tg

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k9cf4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-k9cf4

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-k9cf4

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k9cf4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k9cf4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.425s (2.425s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k9cf4

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-cs5xt

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cs5xt

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-hnzbr

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.436s (2.436s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rqdkj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wnbl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-rqdkj

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4wnbl

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-rqdkj

openshift-ingress

multus

payload-processing-5b54b7fbb7-4wnbl

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wnbl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wnbl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.526s (1.526s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wnbl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rqdkj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rqdkj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rqdkj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.485s (2.485s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-hnzbr

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-831a1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-831a1c

openshift-ingress

deployment-controller

e2e-inf-a-831a1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-831a1c-openshift-default-6bd4488496 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-831a1c-openshift-default-6bd4488496

SuccessfulCreate

Created pod: e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

openshift-ingress

multus

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-831a1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-831a1c-5cdb89ff9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-831a1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-831a1c-867676f9c8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-831a1c: serviceaccount "payload-processing-e2e-inf-a-831a1c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-831a1c-5cdb89ff9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-831a1c-5cdb89ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-831a1c: serviceaccount "payload-processing-e2e-inf-a-831a1c" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-831a1c-5cdb89ff9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

openshift-ingress

kubelet

payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

openshift-ingress

kubelet

payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-5fa7070e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5fa7070e

openshift-ingress

replicaset-controller

e2e-ait-5fa7070e-openshift-default-6d7b96c5d

SuccessfulCreate

Created pod: e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

openshift-ingress

deployment-controller

e2e-ait-5fa7070e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5fa7070e-openshift-default-6d7b96c5d from 0 to 1

openshift-ingress

multus

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-0a8fef-openshift-default-5d48c4d994

SuccessfulCreate

Created pod: e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

openshift-ingress

multus

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-0a8fef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-0a8fef-openshift-default-5d48c4d994 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-0a8fef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-0a8fef
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5fa7070e: serviceaccount "payload-processing-e2e-ait-5fa7070e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5fa7070e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5fa7070e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5fa7070e-667c667f6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5fa7070e-667c667f6f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5fa7070e-667c667f6f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5fa7070e-667c667f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5fa7070e: serviceaccount "payload-processing-e2e-ait-5fa7070e" not found

openshift-ingress

multus

payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0a8fef: serviceaccount "payload-processing-e2e-autores-0a8fef" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0a8fef-6cf4bf45b5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-0a8fef-6cf4bf45b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0a8fef: serviceaccount "payload-processing-e2e-autores-0a8fef" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-0a8fef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-0a8fef-57b59fdb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

openshift-ingress

deployment-controller

payload-processing-e2e-autores-0a8fef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-0a8fef-6cf4bf45b5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0a8fef-6cf4bf45b5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

openshift-ingress

multus

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-7bdb3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-7bdb3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-7bdb3c

openshift-ingress

replicaset-controller

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4

SuccessfulCreate

Created pod: e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf
(x2)

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7bdb3c: serviceaccount "payload-processing-e2e-inf-b-7bdb3c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-7bdb3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-7bdb3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-7bdb3c: serviceaccount "payload-processing-e2e-inf-b-7bdb3c" not found
(x5)

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fa7070e-7b6cdb8ffd-zpk6f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5fa7070e-667c667f6f-4kk59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b

SuccessfulCreate

Created pod: e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

openshift-ingress

deployment-controller

e2e-migrate-1ecf5332-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-1ecf5332-gw-openshift-default-87d59465b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-1ecf5332-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-1ecf5332-gw

openshift-ingress

multus

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-1ecf5332

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-1ecf5332

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-1ecf5332-7db646cd74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-1ecf5332-7db646cd74

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-1ecf5332-7db646cd74

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-1ecf5332-7db646cd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1ecf5332: serviceaccount "payload-processing-e2e-migrate-1ecf5332" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-1ecf5332: serviceaccount "payload-processing-e2e-migrate-1ecf5332" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-1ecf5332-gw-openshift-default-87d59465b-98kpq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-1ecf5332-7db646cd74-rdrvc

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-1d2554f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1d2554f2

openshift-ingress

deployment-controller

e2e-ait-1d2554f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1d2554f2-openshift-default-767948699d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-1ecf5332-68d6fcc65d-fmmjs

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-1d2554f2-openshift-default-767948699d

SuccessfulCreate

Created pod: e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

openshift-ingress

multus

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1d2554f2: serviceaccount "payload-processing-e2e-ait-1d2554f2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1d2554f2-6599c5f989

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1d2554f2-6599c5f989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1d2554f2: serviceaccount "payload-processing-e2e-ait-1d2554f2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1d2554f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1d2554f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1d2554f2-6599c5f989 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1d2554f2-6599c5f989

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

openshift-ingress

kubelet

payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

openshift-ingress

kubelet

payload-processing-e2e-autores-0a8fef-6cf4bf45b5-684hh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a8fef-57b59fdb6-b9sh4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-0a8fef-openshift-default-5d48c4d994-2c2bw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-eefe49-openshift-default-7b75c666d

SuccessfulCreate

Created pod: e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

openshift-ingress

multus

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-eefe49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-eefe49-openshift-default-7b75c666d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-eefe49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-eefe49
(x2)

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-eefe49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-eefe49-76fdbd898b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-eefe49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-eefe49-6f9565f8f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-eefe49-6f9565f8f7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-eefe49-6f9565f8f7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-eefe49-6f9565f8f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-eefe49: serviceaccount "payload-processing-e2e-explicit-eefe49" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-eefe49: serviceaccount "payload-processing-e2e-explicit-eefe49" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

openshift-ingress

kubelet

payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1d2554f2-6599c5f989-m2vfs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1d2554f2-58cb4f76db-mk6l7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-1d2554f2-openshift-default-dockercfg-ssgp5); attempting to pull the image may not succeed.

openshift-ingress

gateway_labeler_controller

e2e-derive-fbfc153d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-fbfc153d

openshift-ingress

replicaset-controller

e2e-derive-fbfc153d-openshift-default-76bc5854d8

SuccessfulCreate

Created pod: e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

openshift-ingress

multus

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-fbfc153d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-fbfc153d-openshift-default-76bc5854d8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-1d2554f2-openshift-default-767948699d-njrf5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-derive-fbfc153d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-fbfc153d-759d6dbbc7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-fbfc153d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fbfc153d-759d6dbbc7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fbfc153d: serviceaccount "payload-processing-e2e-derive-fbfc153d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-fbfc153d-759d6dbbc7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-fbfc153d-759d6dbbc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-fbfc153d: serviceaccount "payload-processing-e2e-derive-fbfc153d" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-fbfc153d-openshift-default-76bc5854d8-whsrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-fbfc153d-759d6dbbc7-8xdm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-fbfc153d-545b5f5df4-tbxtb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-eefe49-6f9565f8f7-z8vjv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-eefe49-76fdbd898b-pcgqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-6bc1bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6bc1bc

openshift-ingress

kubelet

e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-6bc1bc-openshift-default-6fbdff66

SuccessfulCreate

Created pod: e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

openshift-ingress

deployment-controller

e2e-noten-6bc1bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6bc1bc-openshift-default-6fbdff66 from 0 to 1

openshift-ingress

multus

e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-6bc1bc-openshift-default-6fbdff66-888f5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-831a1c-867676f9c8-9rzp2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-831a1c-5cdb89ff9-f62xh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d

SuccessfulCreate

Created pod: e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

openshift-ingress

multus

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-ca9fd5b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ca9fd5b9

openshift-ingress

deployment-controller

e2e-mt-ca9fd5b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ca9fd5b9-openshift-default-59f9f6574d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ca9fd5b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ca9fd5b9-676f66498f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ca9fd5b9-676f66498f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ca9fd5b9: serviceaccount "payload-processing-e2e-mt-ca9fd5b9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ca9fd5b9: serviceaccount "payload-processing-e2e-mt-ca9fd5b9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ca9fd5b9-676f66498f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ca9fd5b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ca9fd5b9-676f66498f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-7bdb3c-6bdbbc9c4f-rdzsq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-7bdb3c-6dd998585d-2b8n6

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-a-w3-c1858a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-c1858a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-c1858a

openshift-ingress

replicaset-controller

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8

SuccessfulCreate

Created pod: e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-7bdb3c-openshift-default-5c44f5b6c4-gfksf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c1858a: serviceaccount "payload-processing-e2e-shared-a-w3-c1858a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-c1858a: serviceaccount "payload-processing-e2e-shared-a-w3-c1858a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-c1858a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-c1858a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": read tcp 10.134.0.2:57222->10.134.0.59:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": read tcp 10.134.0.2:57222->10.134.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-16b799-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-16b799-openshift-default-796fccb654 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-16b799

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-16b799

openshift-ingress

replicaset-controller

e2e-shared-b-w3-16b799-openshift-default-796fccb654

SuccessfulCreate

Created pod: e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

openshift-ingress

kubelet

payload-processing-e2e-mt-ca9fd5b9-676f66498f-xvl2h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ca9fd5b9-5fcd9c9c94-rn8l2

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-ca9fd5b9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-ca9fd5b9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-ca9fd5b9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-ca9fd5b9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2d8add27-ffde-4b41-af07-6693cdf49d5e, UID in object meta:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-16b799: serviceaccount "payload-processing-e2e-shared-b-w3-16b799" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-16b799

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-16b799

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-16b799: serviceaccount "payload-processing-e2e-shared-b-w3-16b799" not found

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-ca9fd5b9-openshift-default-59f9f6574d-24gx7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8

SuccessfulCreate

Created pod: e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

openshift-ingress

deployment-controller

e2e-shared-a-w2-f5e6f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f5e6f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f5e6f7

openshift-ingress

multus

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7: serviceaccount "payload-processing-e2e-shared-a-w2-f5e6f7" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f5e6f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7: serviceaccount "payload-processing-e2e-shared-a-w2-f5e6f7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f5e6f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f81bf2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f81bf2

openshift-ingress

multus

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb

SuccessfulCreate

Created pod: e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

openshift-ingress

deployment-controller

e2e-shared-b-w2-f81bf2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f81bf2: serviceaccount "payload-processing-e2e-shared-b-w2-f81bf2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f81bf2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f81bf2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f81bf2: serviceaccount "payload-processing-e2e-shared-b-w2-f81bf2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-89e681d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-89e681d0-openshift-default-84dff8548d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-89e681d0-openshift-default-84dff8548d

SuccessfulCreate

Created pod: e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

openshift-ingress

gateway_labeler_controller

e2e-mt-89e681d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-89e681d0

openshift-ingress

multus

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-89e681d0-b597bb8cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-89e681d0-56d966f74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-89e681d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-89e681d0-56d966f74b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-89e681d0-b597bb8cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-89e681d0-b597bb8cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-89e681d0: serviceaccount "payload-processing-e2e-mt-89e681d0" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-89e681d0-56d966f74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-89e681d0-56d966f74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-89e681d0: serviceaccount "payload-processing-e2e-mt-89e681d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-89e681d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-89e681d0-b597bb8cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89e681d0-56d966f74b-v6q97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89e681d0-b597bb8cc-9v2cv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-b9198b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b9198b-openshift-default-76989b885d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-b9198b-openshift-default-76989b885d

SuccessfulCreate

Created pod: e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

openshift-ingress

multus

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-b9198b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b9198b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b9198b: serviceaccount "payload-processing-e2e-api-a-b9198b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b9198b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b9198b-6b44bf5d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b9198b-6b44bf5d9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b9198b-6b44bf5d9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b9198b-6b44bf5d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b9198b: serviceaccount "payload-processing-e2e-api-a-b9198b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b9198b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b9198b-6cc45699fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

openshift-ingress

multus

payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-9c1509

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9c1509

openshift-ingress

replicaset-controller

e2e-api-b-9c1509-openshift-default-99bcb6bd8

SuccessfulCreate

Created pod: e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

openshift-ingress

deployment-controller

e2e-api-b-9c1509-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9c1509-openshift-default-99bcb6bd8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9c1509

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9c1509-68f864477f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9c1509-68f864477f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9c1509-68f864477f-27wsq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9c1509: serviceaccount "payload-processing-e2e-api-b-9c1509" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9c1509

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9c1509-68f864477f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9c1509-68f864477f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9c1509: serviceaccount "payload-processing-e2e-api-b-9c1509" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9c1509-68f864477f-27wsq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9c1509-68f864477f-27wsq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-9c1509-68f864477f-27wsq

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9c1509-68f864477f-27wsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-b9198b-6b44bf5d9-xmwlg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-b9198b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-b9198b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-b9198b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-b9198b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 84491d2b-f1dc-4234-b6b4-d4eb7e3ed658, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b9198b-6cc45699fd-r6c7c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-9c1509-68f864477f-27wsq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9c1509-555dcfdbdb-tv4t9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9c1509-openshift-default-99bcb6bd8-sn2n5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f5e6f7-77dd4d6b58-jsnxk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f5e6f7-openshift-default-8c7d757b8-pcjhk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-909c76

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-909c76

openshift-ingress

deployment-controller

e2e-ipp-a-909c76-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-909c76-openshift-default-74cd875b94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-909c76-openshift-default-74cd875b94

SuccessfulCreate

Created pod: e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

openshift-ingress

multus

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-909c76

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-909c76-665f6d9c89 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-909c76-665f6d9c89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-909c76-665f6d9c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-909c76: serviceaccount "payload-processing-e2e-ipp-a-909c76" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-909c76

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-909c76: serviceaccount "payload-processing-e2e-ipp-a-909c76" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-909c76-665f6d9c89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55

Started

Started container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-f81bf2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-f81bf2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18070855-22e2-4268-b655-1264fdf9184b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f81bf2-66bb46bb9-2rmkx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-f81bf2-openshift-default-55f59b48bb-47x5j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-c4902f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c4902f-openshift-default-69c7c9569b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c4902f-openshift-default-69c7c9569b

SuccessfulCreate

Created pod: e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c4902f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c4902f

openshift-ingress

multus

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c4902f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c4902f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c4902f-8564c4797f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c4902f-8564c4797f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c4902f-8564c4797f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c4902f-8564c4797f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c4902f: serviceaccount "payload-processing-e2e-ipp-b-c4902f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c4902f: serviceaccount "payload-processing-e2e-ipp-b-c4902f" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d69099

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d69099

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d69099-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d69099: serviceaccount "payload-processing-e2e-ipp-cleanup-d69099" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d69099

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d69099: serviceaccount "payload-processing-e2e-ipp-cleanup-d69099" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d69099

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d69099-6ddc577858-6njxf

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-d69099

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d69099: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-d69099": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d69099, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2d467de4-1982-437e-a145-4872fb3800e5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d69099-5449b6d65c-b4wdl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-d69099-openshift-default-64fb8b5994-ggjbq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c4902f-5c6f7c79db-vk74p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c4902f-8564c4797f-t5xnw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c4902f-openshift-default-69c7c9569b-m9bcc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-c1858a-579bcf7dbc-svzbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-16b799-openshift-default-796fccb654-wc5q6

Killing

Stopping container istio-proxy