Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2 to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Scheduled

Successfully assigned openshift-ingress/e2e-ait-50a00efc-openshift-default-7985466476-dsl8h to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-80aa25-d8499f755-557zk to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv to ip-10-0-143-160.ec2.internal

openshift-ingress

kube-auth-proxy-556d9c8688-r45j2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-556d9c8688-r45j2 to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs to ip-10-0-129-103.ec2.internal

openshift-ingress

kube-auth-proxy-556d9c8688-7qzx6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-556d9c8688-7qzx6 to ip-10-0-141-185.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-qsxgf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-qsxgf to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-mcl7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-mcl7w to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6 to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5 to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp to ip-10-0-143-160.ec2.internal

openshift-ingress

router-default-644c5d48fd-8jn7w

Scheduled

Successfully assigned openshift-ingress/router-default-644c5d48fd-8jn7w to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4 to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6 to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6 to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76 to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc to ip-10-0-143-160.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-lq8k2

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-lq8k2 to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z to ip-10-0-141-185.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-xtnsb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xtnsb to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl to ip-10-0-141-185.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d66961-589f585555-zdn8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d66961-589f585555-zdn8k to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf to ip-10-0-143-160.ec2.internal

openshift-ingress

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp to ip-10-0-143-160.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-sspzh to ip-10-0-129-103.ec2.internal

openshift-ingress

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr to ip-10-0-129-103.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g to ip-10-0-129-103.ec2.internal
(x6)

openshift-ingress

replicaset-controller

router-default-644c5d48fd

FailedCreate

Error creating: pods "router-default-644c5d48fd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-644c5d48fd from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-644c5d48fd

FailedCreate

Error creating: pods "router-default-644c5d48fd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-644c5d48fd

SuccessfulCreate

Created pod: router-default-644c5d48fd-8jn7w
(x6)

openshift-ingress

kubelet

router-default-644c5d48fd-8jn7w

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-644c5d48fd-8jn7w

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-644c5d48fd-8jn7w

Created

Created container: router

openshift-ingress

kubelet

router-default-644c5d48fd-8jn7w

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-644c5d48fd-8jn7w

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-644c5d48fd-8jn7w

Started

Started container router
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-556d9c8688

FailedCreate

Error creating: pods "kube-auth-proxy-556d9c8688-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-556d9c8688

SuccessfulCreate

Created pod: kube-auth-proxy-556d9c8688-r45j2

openshift-ingress

replicaset-controller

kube-auth-proxy-556d9c8688

SuccessfulCreate

Created pod: kube-auth-proxy-556d9c8688-7qzx6

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-556d9c8688 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-r45j2

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-556d9c8688-7qzx6

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-7qzx6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-xtnsb

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-xtnsb

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-r45j2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-556d9c8688-r45j2

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-7qzx6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-7qzx6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.784s (2.784s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-7qzx6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-r45j2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.644s (2.644s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-r45j2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-556d9c8688-r45j2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.531s (3.531s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qdnc9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.777s (2.777s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-qsxgf

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-qsxgf

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qsxgf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qsxgf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.386s (3.386s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qsxgf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qsxgf

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xtnsb

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-xtnsb

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-sspzh

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-sspzh

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.145s (3.145s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-mcl7w

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-lq8k2
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-mcl7w

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mcl7w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lq8k2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-lq8k2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mcl7w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mcl7w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.691s (1.691s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-mcl7w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lq8k2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lq8k2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-lq8k2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.121s (2.121s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-sspzh

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-80aa25-openshift-default-6f497c79b

SuccessfulCreate

Created pod: e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

openshift-ingress

deployment-controller

e2e-inf-a-80aa25-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-80aa25-openshift-default-6f497c79b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-80aa25

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-80aa25

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-80aa25

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-80aa25-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-80aa25-authn-ssl" already exists

openshift-ingress

multus

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-80aa25

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-80aa25-f5c49c754 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-80aa25-d8499f755

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-80aa25-d8499f755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-80aa25: serviceaccount "payload-processing-e2e-inf-a-80aa25" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-80aa25: serviceaccount "payload-processing-e2e-inf-a-80aa25" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-80aa25

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-80aa25-d8499f755 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-80aa25-d8499f755

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-5d9b44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5d9b44

openshift-ingress

deployment-controller

e2e-autores-5d9b44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5d9b44-openshift-default-795c55bf46 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-c62a32a3-openshift-default-7dff8c4c58

SuccessfulCreate

Created pod: e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

openshift-ingress

multus

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-5d9b44-openshift-default-795c55bf46

SuccessfulCreate

Created pod: e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

openshift-ingress

gateway_labeler_controller

e2e-ait-c62a32a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c62a32a3

openshift-ingress

deployment-controller

e2e-ait-c62a32a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c62a32a3-openshift-default-7dff8c4c58 from 0 to 1

openshift-ingress

multus

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c62a32a3-cc6999685

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c62a32a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c62a32a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c62a32a3-cc6999685 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c62a32a3-cc6999685

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c62a32a3-cc6999685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c62a32a3: serviceaccount "payload-processing-e2e-ait-c62a32a3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c62a32a3: serviceaccount "payload-processing-e2e-ait-c62a32a3" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5d9b44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5d9b44-6b599f49c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5d9b44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5d9b44-59f7574b4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5d9b44: serviceaccount "payload-processing-e2e-autores-5d9b44" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5d9b44-6b599f49c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5d9b44-6b599f49c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5d9b44-6b599f49c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5d9b44: serviceaccount "payload-processing-e2e-autores-5d9b44" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.28s (2.28s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

ProbeError

Readiness probe error: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Unhealthy

Readiness probe failed: Get "http://10.132.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-467fc3-openshift-default-68b6c78c5d

SuccessfulCreate

Created pod: e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

openshift-ingress

deployment-controller

e2e-inf-b-467fc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-467fc3-openshift-default-68b6c78c5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-467fc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-467fc3

openshift-ingress

multus

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-467fc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-467fc3-7ddc48679c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-467fc3-7ddc48679c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-467fc3: serviceaccount "payload-processing-e2e-inf-b-467fc3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-467fc3-7ddc48679c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-467fc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-467fc3-7ddc48679c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-467fc3: serviceaccount "payload-processing-e2e-inf-b-467fc3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:33438->10.133.0.58:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": read tcp 10.133.0.2:33438->10.133.0.58:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-c62a32a3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-c62a32a3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-c62a32a3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1feb3411-0319-4432-8840-2ff1e45f5de2, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c62a32a3-85d7bc9d8b-sspbf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c62a32a3-cc6999685-rbkd4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-c62a32a3-openshift-default-7dff8c4c58-gw9tk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-090c5b75-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-090c5b75-gw-openshift-default-c9df95596 from 0 to 1

openshift-ingress

multus

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-090c5b75-gw-openshift-default-c9df95596

SuccessfulCreate

Created pod: e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

openshift-ingress

gateway_labeler_controller

e2e-migrate-090c5b75-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-090c5b75-gw

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-090c5b75-5cb789d558

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-090c5b75-5cb789d558

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-090c5b75-5cb789d558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-090c5b75: serviceaccount "payload-processing-e2e-migrate-090c5b75" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-090c5b75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-090c5b75: serviceaccount "payload-processing-e2e-migrate-090c5b75" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-090c5b75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-090c5b75-5cb789d558 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-090c5b75-5cb789d558-9qbqp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-090c5b75-gw-openshift-default-c9df95596-g6g45

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-090c5b75-7cb9885cdb-4h4p6

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-50a00efc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-50a00efc

openshift-ingress

deployment-controller

e2e-ait-50a00efc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-50a00efc-openshift-default-7985466476 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-50a00efc-openshift-default-7985466476

SuccessfulCreate

Created pod: e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

openshift-ingress

multus

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-50a00efc-5b5f999b6c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-50a00efc: serviceaccount "payload-processing-e2e-ait-50a00efc" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-50a00efc-5b5f999b6c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-50a00efc-5b5f999b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-50a00efc: serviceaccount "payload-processing-e2e-ait-50a00efc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-50a00efc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-50a00efc-5b5f999b6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-50a00efc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": read tcp 10.133.0.2:44150->10.133.0.61:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": read tcp 10.133.0.2:44150->10.133.0.61:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-50a00efc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-50a00efc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-50a00efc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-50a00efc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 68f9146a-0e46-4b39-a88b-a878b5fef140, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-50a00efc-5b5f999b6c-mvhtr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50a00efc-7f754d8fcd-dfshq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-b1672bb6-openshift-default-5f97f7f564

SuccessfulCreate

Created pod: e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

openshift-ingress

deployment-controller

e2e-derive-b1672bb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b1672bb6-openshift-default-5f97f7f564 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-b1672bb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b1672bb6

openshift-ingress

multus

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-50a00efc-openshift-default-7985466476-dsl8h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.788s (2.789s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b1672bb6: serviceaccount "payload-processing-e2e-derive-b1672bb6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b1672bb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b1672bb6-5f49d58685 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b1672bb6-5f49d58685

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b1672bb6-5f49d58685

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b1672bb6-5f49d58685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b1672bb6: serviceaccount "payload-processing-e2e-derive-b1672bb6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b1672bb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5d9b44-59f7574b4b-nncfs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5d9b44-6b599f49c-6m92g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b1672bb6-5f49d58685-skrtv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1672bb6-cc7d488f4-d7c8g

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

ProbeError

Startup probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-b1672bb6-openshift-default-5f97f7f564-bk6bp

Unhealthy

Startup probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-75dcbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-75dcbb-openshift-default-7c8d979f44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-75dcbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-75dcbb

openshift-ingress

kubelet

e2e-autores-5d9b44-openshift-default-795c55bf46-rgzzl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-75dcbb-openshift-default-7c8d979f44

SuccessfulCreate

Created pod: e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-75dcbb-545b5f767c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

openshift-ingress

multus

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-75dcbb-545b5f767c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-75dcbb-545b5f767c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-75dcbb: serviceaccount "payload-processing-e2e-explicit-75dcbb" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-75dcbb: serviceaccount "payload-processing-e2e-explicit-75dcbb" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-75dcbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-75dcbb-7bddff779d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-75dcbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-75dcbb-545b5f767c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-fc6e011f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fc6e011f

openshift-ingress

deployment-controller

e2e-mt-fc6e011f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fc6e011f-openshift-default-d768fffdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-fc6e011f-openshift-default-d768fffdd

SuccessfulCreate

Created pod: e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

openshift-ingress

multus

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-75dcbb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-75dcbb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-75dcbb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6c14f16f-d257-48dc-a381-6af659567085, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-75dcbb-545b5f767c-drdcr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-75dcbb-7bddff779d-8w2g2

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fc6e011f-57b64c9b57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fc6e011f-57b64c9b57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fc6e011f: serviceaccount "payload-processing-e2e-mt-fc6e011f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fc6e011f: serviceaccount "payload-processing-e2e-mt-fc6e011f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fc6e011f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fc6e011f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fc6e011f-57b64c9b57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fc6e011f-57b64c9b57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

openshift-ingress

kubelet

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-3671a4-openshift-default-7f8d75cf88

SuccessfulCreate

Created pod: e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

openshift-ingress

deployment-controller

e2e-noten-3671a4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3671a4-openshift-default-7f8d75cf88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-3671a4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3671a4

openshift-ingress

kubelet

e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-75dcbb-openshift-default-7c8d979f44-xkqk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

Unhealthy

Readiness probe failed: dial tcp 10.132.0.51:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fc6e011f-d44d96bf8-nxp9b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fc6e011f-57b64c9b57-hwj9x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-fc6e011f-openshift-default-d768fffdd-64n4w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-3671a4-openshift-default-7f8d75cf88-2sh2v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-80aa25-f5c49c754-7kwng

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-80aa25-d8499f755-557zk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-cd89ac

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-cd89ac-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-cd89ac-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-cd89ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-cd89ac

openshift-ingress

deployment-controller

e2e-shared-a-w2-cd89ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d

SuccessfulCreate

Created pod: e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

openshift-ingress

multus

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-80aa25-openshift-default-6f497c79b-bd4ww

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cd89ac: serviceaccount "payload-processing-e2e-shared-a-w2-cd89ac" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-cd89ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cd89ac: serviceaccount "payload-processing-e2e-shared-a-w2-cd89ac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-cd89ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-467fc3-7ddc48679c-dg28p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-467fc3-646ccdc7cd-qs4zt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-467fc3-openshift-default-68b6c78c5d-vnpnr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6

SuccessfulCreate

Created pod: e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-3fc2b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-3fc2b8

openshift-ingress

deployment-controller

e2e-shared-a-w3-3fc2b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-3fc2b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8: serviceaccount "payload-processing-e2e-shared-a-w3-3fc2b8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-3fc2b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-3fc2b8: serviceaccount "payload-processing-e2e-shared-a-w3-3fc2b8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4

SuccessfulCreate

Created pod: e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-3bbb40

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-3bbb40-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-3bbb40-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-3bbb40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-3bbb40

openshift-ingress

deployment-controller

e2e-shared-b-w2-3bbb40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40: serviceaccount "payload-processing-e2e-shared-b-w2-3bbb40" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-3bbb40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3bbb40: serviceaccount "payload-processing-e2e-shared-b-w2-3bbb40" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-3bbb40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:37918->10.134.0.55:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:37918->10.134.0.55:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-shared-b-w3-f4fe4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44

SuccessfulCreate

Created pod: e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-f4fe4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f4fe4f

openshift-ingress

multus

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-f4fe4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f4fe4f: serviceaccount "payload-processing-e2e-shared-b-w3-f4fe4f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f4fe4f: serviceaccount "payload-processing-e2e-shared-b-w3-f4fe4f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-f4fe4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-3d4d0c56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3d4d0c56

openshift-ingress

deployment-controller

e2e-mt-3d4d0c56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3d4d0c56-openshift-default-7b89846776 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-3d4d0c56-openshift-default-7b89846776

SuccessfulCreate

Created pod: e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

openshift-ingress

multus

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3d4d0c56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3d4d0c56-8565dbc797 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3d4d0c56-8565dbc797

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3d4d0c56-8565dbc797-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3d4d0c56: serviceaccount "payload-processing-e2e-mt-3d4d0c56" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3d4d0c56: serviceaccount "payload-processing-e2e-mt-3d4d0c56" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3d4d0c56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3d4d0c56-8565dbc797

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

openshift-ingress

kubelet

payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-3d4d0c56-8565dbc797-cdk76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3d4d0c56-578467cfd6-mrh8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-3d4d0c56-openshift-default-7b89846776-86n7n

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-d66961-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d66961-openshift-default-6fb895bdf6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-d66961

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d66961

openshift-ingress

replicaset-controller

e2e-api-a-d66961-openshift-default-6fb895bdf6

SuccessfulCreate

Created pod: e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d66961-589f585555

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d66961-589f585555-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d66961: serviceaccount "payload-processing-e2e-api-a-d66961" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d66961

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d66961-589f585555 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d66961

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d66961-6f6fcccff4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-d66961-589f585555-zdn8k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d66961-589f585555-zdn8k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d66961-589f585555-zdn8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-d66961-589f585555-zdn8k

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d66961: serviceaccount "payload-processing-e2e-api-a-d66961" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d66961-589f585555

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d66961-589f585555-zdn8k
(x2)

openshift-ingress

kubelet

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-849fe6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-849fe6

openshift-ingress

deployment-controller

e2e-api-b-849fe6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-849fe6-openshift-default-64c4499994 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-849fe6-openshift-default-64c4499994

SuccessfulCreate

Created pod: e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

openshift-ingress

multus

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-849fe6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-849fe6-64bf9fdb9c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-849fe6-64bf9fdb9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-849fe6: serviceaccount "payload-processing-e2e-api-b-849fe6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-849fe6-64bf9fdb9c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-849fe6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-849fe6-64bf9fdb9c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-849fe6: serviceaccount "payload-processing-e2e-api-b-849fe6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-d66961

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-d66961: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-d66961": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-d66961, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 876d2733-e6e5-42cd-af20-3edabc8a8f7c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d66961-6f6fcccff4-c9stl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d66961-589f585555-zdn8k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-d66961-openshift-default-6fb895bdf6-j7tln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-849fe6-64bf9fdb9c-qm86f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-849fe6-75b5cc8bd6-c8ld4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-849fe6-openshift-default-64c4499994-8cd4v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd89ac-cf8d5c4d9-lhgft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd89ac-5497d785db-gksj6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-cd89ac-openshift-default-7cccbd685d-tl65d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3bbb40-77b84c5d9c-2s7s6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-3bbb40

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3bbb40: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-3bbb40": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3bbb40, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4a58baf7-fc3b-45c6-8faa-c48ca290e950, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3bbb40-848bbfbcb6-k4cgb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-3bbb40-openshift-default-7957f8b7c4-dn4mn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-b73da3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-b73da3

openshift-ingress

replicaset-controller

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6

SuccessfulCreate

Created pod: e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

openshift-ingress

deployment-controller

e2e-ipp-a-b73da3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-b73da3-openshift-default-676dfc5bb6 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b73da3: serviceaccount "payload-processing-e2e-ipp-a-b73da3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-b73da3: serviceaccount "payload-processing-e2e-ipp-a-b73da3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-b73da3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-b73da3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-b73da3-c6d7bf45c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d

SuccessfulCreate

Created pod: e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-18b9ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-18b9ac

openshift-ingress

deployment-controller

e2e-ipp-b-18b9ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d from 0 to 1

openshift-ingress

multus

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-18b9ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-18b9ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-18b9ac: serviceaccount "payload-processing-e2e-ipp-b-18b9ac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-18b9ac: serviceaccount "payload-processing-e2e-ipp-b-18b9ac" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

ProbeError

Readiness probe error: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Unhealthy

Readiness probe failed: Get "http://10.132.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-eb2a90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-eb2a90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-eb2a90
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eb2a90: serviceaccount "payload-processing-e2e-ipp-cleanup-eb2a90" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eb2a90: serviceaccount "payload-processing-e2e-ipp-cleanup-eb2a90" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-eb2a90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-eb2a90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb2a90-d9cf8bcd5-l5zw5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb2a90-84bcd8c5c4-d4tpd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-eb2a90-openshift-default-5bcbcb65c4-9s8zw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-b73da3-c6d7bf45c-fqw9j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-b73da3-5c8977fc6b-b5dkh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-b73da3-openshift-default-676dfc5bb6-pxwqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-18b9ac-6cf5b5c9f-2whf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-18b9ac-5f79c684b-6hxxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-18b9ac-openshift-default-d7d8dc98d-pgz2z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3fc2b8-5654d5c97d-6srpg

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-3fc2b8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-3fc2b8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3fc2b8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08ef32a3-4b96-42e3-81ab-955b67c7d3e3, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3fc2b8-84df7ff755-924gk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-3fc2b8-openshift-default-f69f68fc6-5njdh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f4fe4f-698489dd7f-jq8jc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f4fe4f-5677bc67d-dlvqc

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-f4fe4f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-f4fe4f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f4fe4f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 92a0bcec-1260-4f21-8ef8-32dca9a958d4, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-f4fe4f-openshift-default-6544cdf44-zfv6k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503