Time Namespace Component RelatedObject Reason Message

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-862d2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-862d2 to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9 to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k to ip-10-0-136-185.ec2.internal

openshift-ingress

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-q2vlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-q2vlj to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr to ip-10-0-136-185.ec2.internal

openshift-ingress

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8 to ip-10-0-136-185.ec2.internal

openshift-ingress

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8 to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh to ip-10-0-136-185.ec2.internal

openshift-ingress

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt to ip-10-0-143-228.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-kzpkn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl to ip-10-0-143-228.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-lzj5s to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88 to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s to ip-10-0-135-240.ec2.internal

openshift-ingress

kube-auth-proxy-6bc78fcbdb-tr229

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6bc78fcbdb-tr229 to ip-10-0-136-185.ec2.internal

openshift-ingress

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-pw62n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-pw62n to ip-10-0-143-228.ec2.internal

openshift-ingress

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n to ip-10-0-143-228.ec2.internal

openshift-ingress

router-default-679f8486cd-4ktr5

Scheduled

Successfully assigned openshift-ingress/router-default-679f8486cd-4ktr5 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

Scheduled

Successfully assigned openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z to ip-10-0-135-240.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v to ip-10-0-135-240.ec2.internal

openshift-ingress

kube-auth-proxy-6bc78fcbdb-lmldp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6bc78fcbdb-lmldp to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-be2171-openshift-default-c98f567c6-6d2md to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8 to ip-10-0-143-228.ec2.internal

openshift-ingress

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m to ip-10-0-143-228.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4 to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk to ip-10-0-136-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p to ip-10-0-136-185.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-679f8486cd from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-679f8486cd

FailedCreate

Error creating: pods "router-default-679f8486cd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-679f8486cd

FailedCreate

Error creating: pods "router-default-679f8486cd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-679f8486cd

SuccessfulCreate

Created pod: router-default-679f8486cd-4ktr5
(x5)

openshift-ingress

kubelet

router-default-679f8486cd-4ktr5

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-679f8486cd-4ktr5

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-679f8486cd-4ktr5

Started

Started container router

openshift-ingress

kubelet

router-default-679f8486cd-4ktr5

Created

Created container: router

openshift-ingress

kubelet

router-default-679f8486cd-4ktr5

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

multus

router-default-679f8486cd-4ktr5

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-lmldp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-tr229

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6bc78fcbdb from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-6bc78fcbdb

SuccessfulCreate

Created pod: kube-auth-proxy-6bc78fcbdb-tr229

openshift-ingress

replicaset-controller

kube-auth-proxy-6bc78fcbdb

SuccessfulCreate

Created pod: kube-auth-proxy-6bc78fcbdb-lmldp

openshift-ingress

multus

kube-auth-proxy-6bc78fcbdb-tr229

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6bc78fcbdb-lmldp

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6bc78fcbdb

FailedCreate

Error creating: pods "kube-auth-proxy-6bc78fcbdb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-862d2

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-862d2

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-lmldp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.762s (2.762s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-lmldp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-lmldp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-tr229

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.034s (4.034s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-tr229

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.245s (3.245s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6bc78fcbdb-tr229

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.662s (2.662s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-kzpkn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kzpkn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-kzpkn

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kzpkn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kzpkn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.286s (2.286s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-kzpkn

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-862d2

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

ProbeError

Readiness probe error: Get "http://10.134.0.20:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-862d2

Unhealthy

Readiness probe failed: Get "http://10.134.0.20:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-lzj5s

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.51s (2.51s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-pw62n

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-q2vlj

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-q2vlj

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-q2vlj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-pw62n

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pw62n

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pw62n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pw62n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.269s (2.269s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pw62n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-q2vlj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.242s (2.242s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-q2vlj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-q2vlj

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-lzj5s

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-d94b9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d94b9e-openshift-default-85797b5cc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d94b9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d94b9e

openshift-ingress

multus

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-674263-openshift-default-6644996b96

SuccessfulCreate

Created pod: e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

openshift-ingress

deployment-controller

e2e-worker-w4-674263-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-674263-openshift-default-6644996b96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-674263

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-674263

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d6291d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d6291d

openshift-ingress

deployment-controller

e2e-inf-a-d6291d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d6291d-openshift-default-7486cb767d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-d6291d-openshift-default-7486cb767d

SuccessfulCreate

Created pod: e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

openshift-ingress

multus

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4

SuccessfulCreate

Created pod: e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

openshift-ingress

multus

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d6291d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d6291d-5fdc7d94f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d6291d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d6291d-5fdc7d94f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d6291d-5fdc7d94f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d6291d-5fdc7d94f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d6291d: serviceaccount "payload-processing-e2e-inf-a-d6291d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d6291d: serviceaccount "payload-processing-e2e-inf-a-d6291d" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-674263-579fb89d74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-674263

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-674263-565d4c87c9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-674263-565d4c87c9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-674263-565d4c87c9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-674263-565d4c87c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-674263: serviceaccount "payload-processing-e2e-worker-w4-674263" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-674263

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-674263-579fb89d74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-674263-579fb89d74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-674263-579fb89d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-674263: serviceaccount "payload-processing-e2e-worker-w4-674263" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d94b9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d94b9e-cd84d77 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d94b9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 383ms (383ms including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d94b9e-cd84d77

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d94b9e-cd84d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d94b9e: serviceaccount "payload-processing-e2e-worker-w0-d94b9e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d94b9e-cd84d77

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

openshift-ingress

replicaset-controller

e2e-autores-1d073e-openshift-default-797fbf4d4b

SuccessfulCreate

Created pod: e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-autores-1d073e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1d073e-openshift-default-797fbf4d4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d94b9e: serviceaccount "payload-processing-e2e-worker-w0-d94b9e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.44s (1.44s including waiting). Image size: 166449312 bytes.

openshift-ingress

gateway_labeler_controller

e2e-autores-1d073e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1d073e

openshift-ingress

gateway_labeler_controller

e2e-ait-6c083038

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6c083038

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-6c083038-openshift-default-7cb89d84c8

SuccessfulCreate

Created pod: e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

openshift-ingress

multus

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-6c083038-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6c083038-openshift-default-7cb89d84c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.979s (1.979s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.928s (1.928s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.038s (3.038s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1d073e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1d073e-dfd798d4f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1d073e-86f694cfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1d073e-86f694cfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1d073e: serviceaccount "payload-processing-e2e-autores-1d073e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1d073e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1d073e-86f694cfb6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1d073e-dfd798d4f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1d073e-dfd798d4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1d073e: serviceaccount "payload-processing-e2e-autores-1d073e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1d073e-dfd798d4f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

openshift-ingress

kubelet

payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1d073e-86f694cfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6c083038

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6c083038-6566f8f54b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6c083038

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6c083038-65ffc97fb9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6c083038-6566f8f54b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6c083038-6566f8f54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6c083038: serviceaccount "payload-processing-e2e-ait-6c083038" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6c083038-65ffc97fb9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6c083038-65ffc97fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6c083038: serviceaccount "payload-processing-e2e-ait-6c083038" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6c083038-65ffc97fb9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

openshift-ingress

multus

payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6c083038-6566f8f54b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

openshift-ingress

multus

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-d5f7da-openshift-default-585dfd4b46

SuccessfulCreate

Created pod: e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

openshift-ingress

deployment-controller

e2e-inf-b-d5f7da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d5f7da-openshift-default-585dfd4b46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d5f7da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d5f7da
(x2)

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d5f7da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d5f7da-5667fcc597 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d5f7da: serviceaccount "payload-processing-e2e-inf-b-d5f7da" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d5f7da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d5f7da-5667fcc597

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d5f7da-5667fcc597

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d5f7da-5667fcc597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d5f7da: serviceaccount "payload-processing-e2e-inf-b-d5f7da" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-6c083038-65ffc97fb9-dpmw8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-64cc2d85-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-64cc2d85-gw

openshift-ingress

replicaset-controller

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68

SuccessfulCreate

Created pod: e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

openshift-ingress

deployment-controller

e2e-migrate-64cc2d85-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68 from 0 to 1

openshift-ingress

multus

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-64cc2d85: serviceaccount "payload-processing-e2e-migrate-64cc2d85" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-64cc2d85-59f8574f58

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-64cc2d85-59f8574f58

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-64cc2d85-59f8574f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-64cc2d85: serviceaccount "payload-processing-e2e-migrate-64cc2d85" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-64cc2d85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-64cc2d85-59f8574f58 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-64cc2d85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-5b1253e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5b1253e5-openshift-default-5cc69869d4 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-64cc2d85-gw-openshift-default-5f84cdbb68-tln8n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-5b1253e5-openshift-default-5cc69869d4

SuccessfulCreate

Created pod: e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

openshift-ingress

gateway_labeler_controller

e2e-ait-5b1253e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5b1253e5

openshift-ingress

multus

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5b1253e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5b1253e5-7b5d5d7555 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5b1253e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5b1253e5-8545566cd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

openshift-ingress

multus

payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5b1253e5: serviceaccount "payload-processing-e2e-ait-5b1253e5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5b1253e5-7b5d5d7555

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5b1253e5-7b5d5d7555

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5b1253e5-7b5d5d7555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5b1253e5: serviceaccount "payload-processing-e2e-ait-5b1253e5" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-2c301e6b-openshift-default-5f578bd4cb

SuccessfulCreate

Created pod: e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

openshift-ingress

deployment-controller

e2e-derive-2c301e6b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2c301e6b-openshift-default-5f578bd4cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-2c301e6b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2c301e6b

openshift-ingress

multus

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2c301e6b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2c301e6b-7b49fc646 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2c301e6b: serviceaccount "payload-processing-e2e-derive-2c301e6b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2c301e6b-7bd6b689b5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2c301e6b-7bd6b689b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2c301e6b: serviceaccount "payload-processing-e2e-derive-2c301e6b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2c301e6b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2c301e6b-7bd6b689b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

openshift-ingress

multus

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2c301e6b-7bd6b689b5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1d073e-86f694cfb6-xnhf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1d073e-dfd798d4f-gtgfh

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff

Killing

Stopping container payload-pre-processing
(x3)

openshift-ingress

kubelet

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-2c301e6b-openshift-default-5f578bd4cb-4f48m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-be2171

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-be2171

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-be2171-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-be2171-openshift-default-c98f567c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-be2171-openshift-default-c98f567c6

SuccessfulCreate

Created pod: e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

openshift-ingress

multus

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-be2171-7b549c4958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-be2171-7b549c4958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-be2171: serviceaccount "payload-processing-e2e-explicit-be2171" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-be2171-5c4c89446f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-be2171-7b549c4958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

openshift-ingress

multus

payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-be2171

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-be2171-7b549c4958 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-be2171

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-be2171-5c4c89446f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-be2171-5c4c89446f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-be2171-5c4c89446f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-be2171: serviceaccount "payload-processing-e2e-explicit-be2171" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-870f71c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-870f71c0-openshift-default-7dd6c5cb8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-870f71c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-870f71c0

openshift-ingress

replicaset-controller

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d

SuccessfulCreate

Created pod: e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

openshift-ingress

multus

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-870f71c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-870f71c0-598f6c4457 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-870f71c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-870f71c0-8649575654 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-870f71c0-8649575654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-870f71c0-8649575654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-870f71c0-8649575654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-870f71c0: serviceaccount "payload-processing-e2e-mt-870f71c0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-870f71c0-598f6c4457

SuccessfulCreate

Created pod: payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-870f71c0-598f6c4457

FailedCreate

Error creating: pods "payload-processing-e2e-mt-870f71c0-598f6c4457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-870f71c0: serviceaccount "payload-processing-e2e-mt-870f71c0" not found

openshift-ingress

multus

payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Unhealthy

Readiness probe failed: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:36134->10.132.0.65:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

ProbeError

Readiness probe error: Get "http://10.132.0.65:15021/healthz/ready": read tcp 10.132.0.2:36134->10.132.0.65:15021: read: connection reset by peer body:
(x5)

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-870f71c0-8649575654-226c4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-870f71c0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-870f71c0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-870f71c0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-870f71c0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ebbcf849-24ec-48d2-8e2d-c04a03b57562, UID in object meta:

openshift-ingress

replicaset-controller

e2e-noten-03d45c-openshift-default-cc8f54458

SuccessfulCreate

Created pod: e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

openshift-ingress

kubelet

e2e-explicit-be2171-openshift-default-c98f567c6-6d2md

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-03d45c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-03d45c

openshift-ingress

deployment-controller

e2e-noten-03d45c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-03d45c-openshift-default-cc8f54458 from 0 to 1

openshift-ingress

multus

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-047bea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-047bea

openshift-ingress

replicaset-controller

e2e-shared-a-w2-047bea-openshift-default-5846d78f48

SuccessfulCreate

Created pod: e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

openshift-ingress

deployment-controller

e2e-shared-a-w2-047bea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-047bea-openshift-default-5846d78f48 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-047bea-79c8548487

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-047bea-79c8548487-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-047bea: serviceaccount "payload-processing-e2e-shared-a-w2-047bea" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-047bea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-047bea: serviceaccount "payload-processing-e2e-shared-a-w2-047bea" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-047bea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-047bea-79c8548487 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-047bea-79c8548487

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d

SuccessfulCreate

Created pod: e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

openshift-ingress

deployment-controller

e2e-shared-b-w2-9838c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-9838c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-9838c2

openshift-ingress

multus

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2: serviceaccount "payload-processing-e2e-shared-b-w2-9838c2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-9838c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-9838c2-5c97498b45 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2: serviceaccount "payload-processing-e2e-shared-b-w2-9838c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-9838c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d6291d-5fdc7d94f-8gjq8

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-166dc9bb-openshift-default-6768bf4dcb

SuccessfulCreate

Created pod: e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

openshift-ingress

deployment-controller

e2e-mt-166dc9bb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-166dc9bb-openshift-default-6768bf4dcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-166dc9bb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-166dc9bb

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-166dc9bb-7b4975fdc7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

openshift-ingress

deployment-controller

payload-processing-e2e-mt-166dc9bb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-166dc9bb-7b4975fdc7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-166dc9bb-7b4975fdc7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-166dc9bb-7b4975fdc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-166dc9bb: serviceaccount "payload-processing-e2e-mt-166dc9bb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-166dc9bb-7969584586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-166dc9bb-7969584586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-166dc9bb: serviceaccount "payload-processing-e2e-mt-166dc9bb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-166dc9bb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-166dc9bb-7969584586 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-166dc9bb-7969584586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Unhealthy

Readiness probe failed: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:47944->10.134.0.66:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

ProbeError

Readiness probe error: Get "http://10.134.0.66:15021/healthz/ready": read tcp 10.134.0.2:47944->10.134.0.66:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d5f7da-cd6fff666-5fkmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-57b6ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6

SuccessfulCreate

Created pod: e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w3-57b6ce

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w3-57b6ce-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w3-57b6ce-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-57b6ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-57b6ce

openshift-ingress

multus

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-57b6ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-57b6ce: serviceaccount "payload-processing-e2e-shared-a-w3-57b6ce" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-57b6ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-57b6ce: serviceaccount "payload-processing-e2e-shared-a-w3-57b6ce" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5547b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5547b6

openshift-ingress

deployment-controller

e2e-shared-b-w3-5547b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5547b6-openshift-default-6576cf4476 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476

SuccessfulCreate

Created pod: e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

openshift-ingress

multus

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5547b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6: serviceaccount "payload-processing-e2e-shared-b-w3-5547b6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5547b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6: serviceaccount "payload-processing-e2e-shared-b-w3-5547b6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-166dc9bb-openshift-default-6768bf4dcb-h7lbm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-c3d85f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c3d85f

openshift-ingress

multus

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-c3d85f-openshift-default-5754c49454

SuccessfulCreate

Created pod: e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

openshift-ingress

deployment-controller

e2e-api-a-c3d85f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c3d85f-openshift-default-5754c49454 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c3d85f-85c49fff7c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c3d85f-98599d96b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c3d85f-98599d96b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c3d85f: serviceaccount "payload-processing-e2e-api-a-c3d85f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c3d85f-85c49fff7c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c3d85f-85c49fff7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c3d85f: serviceaccount "payload-processing-e2e-api-a-c3d85f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c3d85f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c3d85f-98599d96b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c3d85f-98599d96b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c3d85f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c3d85f-85c49fff7c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-13f9e5-openshift-default-6bbbc64d48

SuccessfulCreate

Created pod: e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

openshift-ingress

deployment-controller

e2e-api-b-13f9e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-13f9e5-openshift-default-6bbbc64d48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-13f9e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-13f9e5

openshift-ingress

multus

e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-13f9e5-77d7c785cf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

openshift-ingress

kubelet

payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-13f9e5-77d7c785cf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-13f9e5-77d7c785cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-13f9e5: serviceaccount "payload-processing-e2e-api-b-13f9e5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-13f9e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-13f9e5-77d7c785cf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-13f9e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-13f9e5: serviceaccount "payload-processing-e2e-api-b-13f9e5" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d94b9e-cd84d77-hd88x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d94b9e-57d4f777b6-tslhj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c3d85f-85c49fff7c-657d8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-c3d85f-openshift-default-5754c49454-g82nl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-13f9e5-6f594f7fcd-8t98g

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-13f9e5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-13f9e5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-13f9e5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-13f9e5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 655bf8fb-7456-4d91-b0f3-84751f972444, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-047bea-openshift-default-5846d78f48-87bqt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-9838c2-5dc444f4cd-hnphk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-674263

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-674263: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-674263": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-674263, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 62a24bdb-46e3-41a0-ae59-5c0664fbe89b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-674263-565d4c87c9-wpr88

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-674263-openshift-default-6644996b96-mpjct

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-953438

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-953438

openshift-ingress

replicaset-controller

e2e-ipp-a-953438-openshift-default-65798956cd

SuccessfulCreate

Created pod: e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

openshift-ingress

multus

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-953438-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-953438-openshift-default-65798956cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-953438

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-953438-649695df74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-953438

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-953438-79fd59b585 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-953438-649695df74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-953438-649695df74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-953438: serviceaccount "payload-processing-e2e-ipp-a-953438" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-953438-79fd59b585

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-953438-79fd59b585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-953438: serviceaccount "payload-processing-e2e-ipp-a-953438" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-953438-79fd59b585

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-953438-649695df74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-9c0eb2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4

SuccessfulCreate

Created pod: e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-9c0eb2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-9c0eb2

openshift-ingress

multus

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-9c0eb2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-9c0eb2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-9c0eb2-674f4f784f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9c0eb2: serviceaccount "payload-processing-e2e-ipp-b-9c0eb2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-9c0eb2: serviceaccount "payload-processing-e2e-ipp-b-9c0eb2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-e91414

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-e91414

openshift-ingress

deployment-controller

e2e-ipp-cleanup-e91414-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-e91414-openshift-default-7878f699d4 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-e91414

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-e91414

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414: serviceaccount "payload-processing-e2e-ipp-cleanup-e91414" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414: serviceaccount "payload-processing-e2e-ipp-cleanup-e91414" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-e91414-openshift-default-7878f699d4-f5x9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-953438

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-953438: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-953438": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-953438, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 53fa0212-93a0-49aa-a9c8-8cad4ce1f5b4, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-9c0eb2-674f4f784f-clxft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-9c0eb2-765b9f6b74-twlrr

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-9c0eb2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-9c0eb2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-9c0eb2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-9c0eb2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9027a48e-fd61-4201-bc3d-e852ed5537c9, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57b6ce-5cd84f68c5-n6t8k

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-57b6ce

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-57b6ce": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ead26c1c-b9e2-4e82-9784-fa882e11068b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-57b6ce-openshift-default-784d9c79c6-t2vkc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5547b6-576c844cb6-jz58p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl

Killing

Stopping container istio-proxy