Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8 to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96 to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7 to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d to ip-10-0-135-158.ec2.internal

openshift-ingress

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs to ip-10-0-137-187.ec2.internal

openshift-ingress

kube-auth-proxy-6c8d5d5c67-mtqtw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6c8d5d5c67-mtqtw to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54 to ip-10-0-137-187.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-swzr7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-swzr7 to ip-10-0-137-187.ec2.internal

openshift-ingress

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7 to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-69911538-openshift-default-64b5648d48-l6dmd to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl to ip-10-0-137-187.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-wpxt6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-wpxt6 to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv to ip-10-0-137-187.ec2.internal

openshift-ingress

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc to ip-10-0-129-99.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7 to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8 to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922 to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-69911538-694ddf7675-hdjh5 to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5 to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-f6bkm

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-f6bkm to ip-10-0-135-158.ec2.internal

openshift-ingress

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq to ip-10-0-135-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx to ip-10-0-135-158.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw to ip-10-0-129-99.ec2.internal

openshift-ingress

router-default-7f6c8f5bc8-h8tgh

Scheduled

Successfully assigned openshift-ingress/router-default-7f6c8f5bc8-h8tgh to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4 to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Scheduled

Successfully assigned openshift-ingress/e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

Scheduled

Successfully assigned openshift-ingress/e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9 to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-dhhh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-dhhh5 to ip-10-0-137-187.ec2.internal

openshift-ingress

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6 to ip-10-0-137-187.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7mxfq to ip-10-0-137-187.ec2.internal

openshift-ingress

kube-auth-proxy-6c8d5d5c67-c62cx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6c8d5d5c67-c62cx to ip-10-0-135-158.ec2.internal

openshift-ingress

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5 to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk to ip-10-0-137-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k to ip-10-0-135-158.ec2.internal

openshift-ingress

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d to ip-10-0-129-99.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2 to ip-10-0-129-99.ec2.internal

openshift-ingress

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4 to ip-10-0-129-99.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7f6c8f5bc8 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-7f6c8f5bc8

FailedCreate

Error creating: pods "router-default-7f6c8f5bc8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7f6c8f5bc8

FailedCreate

Error creating: pods "router-default-7f6c8f5bc8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7f6c8f5bc8

SuccessfulCreate

Created pod: router-default-7f6c8f5bc8-h8tgh
(x5)

openshift-ingress

kubelet

router-default-7f6c8f5bc8-h8tgh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7f6c8f5bc8-h8tgh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7f6c8f5bc8-h8tgh

Created

Created container: router

openshift-ingress

kubelet

router-default-7f6c8f5bc8-h8tgh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-7f6c8f5bc8-h8tgh

AddedInterface

Add eth0 [10.133.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7f6c8f5bc8-h8tgh

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-6c8d5d5c67

SuccessfulCreate

Created pod: kube-auth-proxy-6c8d5d5c67-mtqtw

openshift-ingress

replicaset-controller

kube-auth-proxy-6c8d5d5c67

SuccessfulCreate

Created pod: kube-auth-proxy-6c8d5d5c67-c62cx

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6c8d5d5c67 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-6c8d5d5c67

FailedCreate

Error creating: pods "kube-auth-proxy-6c8d5d5c67-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-c62cx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-mtqtw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6c8d5d5c67-mtqtw

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6c8d5d5c67-c62cx

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-c62cx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-mtqtw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.859s (2.859s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-c62cx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-mtqtw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-mtqtw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c8d5d5c67-c62cx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.813s (2.813s including waiting). Image size: 265120132 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-swzr7

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-swzr7

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.854s (2.854s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.476s (2.476s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m2bj7

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-wpxt6

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-wpxt6

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wpxt6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wpxt6

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wpxt6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.322s (2.322s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wpxt6

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wpxt6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wpxt6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-swzr7

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-swzr7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-7mxfq

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.587s (2.587s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-f6bkm

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-dhhh5

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-f6bkm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-f6bkm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-dhhh5

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dhhh5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-f6bkm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-f6bkm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.831s (1.831s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-f6bkm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dhhh5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dhhh5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dhhh5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.128s (2.128s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

ProbeError

Startup probe error: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7mxfq

Unhealthy

Startup probe failed: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-5eef90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-5eef90

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-47e41c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-47e41c

openshift-ingress

replicaset-controller

e2e-inf-a-5eef90-openshift-default-5545bdc57d

SuccessfulCreate

Created pod: e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

openshift-ingress

replicaset-controller

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4

SuccessfulCreate

Created pod: e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

openshift-ingress

deployment-controller

e2e-worker-w0-d36b91-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d36b91-openshift-default-75b96fb6c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d36b91

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d36b91

openshift-ingress

deployment-controller

e2e-inf-a-5eef90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-5eef90-openshift-default-5545bdc57d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-47e41c-openshift-default-7b648cdf56

SuccessfulCreate

Created pod: e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

openshift-ingress

deployment-controller

e2e-worker-w4-47e41c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-47e41c-openshift-default-7b648cdf56 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-5eef90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-5eef90-546c7855bf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5eef90-546c7855bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-5eef90-546c7855bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5eef90: serviceaccount "payload-processing-e2e-inf-a-5eef90" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-5eef90-546c7855bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-5eef90: serviceaccount "payload-processing-e2e-inf-a-5eef90" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-5eef90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-47e41c: serviceaccount "payload-processing-e2e-worker-w4-47e41c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-47e41c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-47e41c-5d75b77d59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-47e41c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-47e41c-868d5c966 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-47e41c-5d75b77d59

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-47e41c-5d75b77d59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-47e41c: serviceaccount "payload-processing-e2e-worker-w4-47e41c" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-47e41c-5d75b77d59

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

openshift-ingress

multus

payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d36b91

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d36b91-5449797478 from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-864e4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-864e4e-openshift-default-6c8d96c55d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d36b91-5449797478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d36b91

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d36b91-6747cb4dd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d36b91-5449797478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d36b91-5449797478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d36b91: serviceaccount "payload-processing-e2e-worker-w0-d36b91" not found

openshift-ingress

replicaset-controller

e2e-autores-864e4e-openshift-default-6c8d96c55d

SuccessfulCreate

Created pod: e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d36b91: serviceaccount "payload-processing-e2e-worker-w0-d36b91" not found

openshift-ingress

gateway_labeler_controller

e2e-autores-864e4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-864e4e

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf

Started

Started container payload-processing

openshift-ingress

multus

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-04cfc947-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-04cfc947-openshift-default-b89b6cb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-04cfc947

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-04cfc947

openshift-ingress

replicaset-controller

e2e-ait-04cfc947-openshift-default-b89b6cb4

SuccessfulCreate

Created pod: e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

openshift-ingress

GatewayAuthBootstrap

e2e-ait-04cfc947

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-04cfc947-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-04cfc947-authn-ssl" already exists

openshift-ingress

multus

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-864e4e-6c8c68d685

FailedCreate

Error creating: pods "payload-processing-e2e-autores-864e4e-6c8c68d685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-864e4e: serviceaccount "payload-processing-e2e-autores-864e4e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-864e4e-76cc88b88b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-864e4e-76cc88b88b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-864e4e: serviceaccount "payload-processing-e2e-autores-864e4e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-864e4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-864e4e-6c8c68d685 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-864e4e-6c8c68d685

SuccessfulCreate

Created pod: payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-864e4e-76cc88b88b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-864e4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-864e4e-76cc88b88b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-04cfc947

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-04cfc947-f65f64b46 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04cfc947-555754c4cf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-04cfc947-555754c4cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04cfc947: serviceaccount "payload-processing-e2e-ait-04cfc947" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04cfc947-555754c4cf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

openshift-ingress

multus

payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04cfc947-f65f64b46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04cfc947-f65f64b46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-04cfc947-f65f64b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04cfc947: serviceaccount "payload-processing-e2e-ait-04cfc947" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-04cfc947

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-04cfc947-555754c4cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.827s (2.827s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-423e6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-423e6a

openshift-ingress

replicaset-controller

e2e-inf-b-423e6a-openshift-default-766d9b8f86

SuccessfulCreate

Created pod: e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

openshift-ingress

deployment-controller

e2e-inf-b-423e6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-423e6a-openshift-default-766d9b8f86 from 0 to 1

openshift-ingress

multus

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-423e6a: serviceaccount "payload-processing-e2e-inf-b-423e6a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-423e6a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-423e6a-6579667cfd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-423e6a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-423e6a-67ccc6f49c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-423e6a-67ccc6f49c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-423e6a-67ccc6f49c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-423e6a-67ccc6f49c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-423e6a: serviceaccount "payload-processing-e2e-inf-b-423e6a" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04cfc947-f65f64b46-xlthl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-04cfc947-555754c4cf-zq9bk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-04cfc947-openshift-default-b89b6cb4-l2v9m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-8cfb58ee-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8cfb58ee-gw

openshift-ingress

deployment-controller

e2e-migrate-8cfb58ee-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b

SuccessfulCreate

Created pod: e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

openshift-ingress

multus

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8cfb58ee-c87845758

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8cfb58ee-c87845758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8cfb58ee: serviceaccount "payload-processing-e2e-migrate-8cfb58ee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8cfb58ee-c87845758

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8cfb58ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8cfb58ee-c87845758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8cfb58ee: serviceaccount "payload-processing-e2e-migrate-8cfb58ee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8cfb58ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8cfb58ee-5958d57f66-76h6c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-8cfb58ee-gw-openshift-default-67bf66f45b-fxnls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-8cfb58ee-c87845758-wxjcr

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-69911538-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-69911538-openshift-default-64b5648d48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-69911538

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-69911538

openshift-ingress

replicaset-controller

e2e-ait-69911538-openshift-default-64b5648d48

SuccessfulCreate

Created pod: e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

openshift-ingress

multus

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-69911538-7cd58b96c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-69911538-7cd58b96c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-69911538-7cd58b96c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-69911538: serviceaccount "payload-processing-e2e-ait-69911538" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-69911538-694ddf7675

FailedCreate

Error creating: pods "payload-processing-e2e-ait-69911538-694ddf7675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-69911538: serviceaccount "payload-processing-e2e-ait-69911538" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-69911538

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-69911538-7cd58b96c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-69911538-694ddf7675

SuccessfulCreate

Created pod: payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

openshift-ingress

deployment-controller

payload-processing-e2e-ait-69911538

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-69911538-694ddf7675 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-69911538-7cd58b96c4-g7tfn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-69911538-694ddf7675-hdjh5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-69911538-openshift-default-64b5648d48-l6dmd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56

SuccessfulCreate

Created pod: e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

openshift-ingress

deployment-controller

e2e-derive-c4796c6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c4796c6d-openshift-default-6d6dfd5c56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-c4796c6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c4796c6d

openshift-ingress

multus

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c4796c6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c4796c6d-678cf978b9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c4796c6d-678cf978b9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c4796c6d-678cf978b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c4796c6d: serviceaccount "payload-processing-e2e-derive-c4796c6d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c4796c6d: serviceaccount "payload-processing-e2e-derive-c4796c6d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c4796c6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c4796c6d-678cf978b9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

openshift-ingress

kubelet

payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-864e4e-76cc88b88b-zcznq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-864e4e-6c8c68d685-bj2rk

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c4796c6d-bb9799dbb-xm2m8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c4796c6d-678cf978b9-8xgwn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-c4796c6d-openshift-default-6d6dfd5c56-9zss5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-explicit-2d4edf-openshift-default-545bcf5bd4

SuccessfulCreate

Created pod: e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

openshift-ingress

deployment-controller

e2e-explicit-2d4edf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-2d4edf-openshift-default-545bcf5bd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-2d4edf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-2d4edf

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-864e4e-openshift-default-6c8d96c55d-vkmss

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-2d4edf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-2d4edf-595d4b596f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2d4edf-595d4b596f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2d4edf-595d4b596f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-2d4edf-595d4b596f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2d4edf: serviceaccount "payload-processing-e2e-explicit-2d4edf" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2d4edf: serviceaccount "payload-processing-e2e-explicit-2d4edf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-2d4edf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-e2f4649f-openshift-default-77f867b948

SuccessfulCreate

Created pod: e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

openshift-ingress

gateway_labeler_controller

e2e-mt-e2f4649f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e2f4649f

openshift-ingress

deployment-controller

e2e-mt-e2f4649f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e2f4649f-openshift-default-77f867b948 from 0 to 1

openshift-ingress

multus

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e2f4649f-657d677566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e2f4649f-657d677566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e2f4649f-657d677566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e2f4649f: serviceaccount "payload-processing-e2e-mt-e2f4649f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e2f4649f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e2f4649f-657d677566 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e2f4649f-6c8555c6f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e2f4649f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e2f4649f-6c8555c6f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e2f4649f-6c8555c6f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e2f4649f-6c8555c6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e2f4649f: serviceaccount "payload-processing-e2e-mt-e2f4649f" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d4edf-595d4b596f-swj8r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d4edf-756bd96bbb-29lsh

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-e2f4649f-6c8555c6f7-ns4bw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e2f4649f-657d677566-bq9lx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e2f4649f-openshift-default-77f867b948-8nf4h

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-e7c6aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-e7c6aa

openshift-ingress

kubelet

e2e-explicit-2d4edf-openshift-default-545bcf5bd4-sgmm4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-e7c6aa-openshift-default-dd66d99b6

SuccessfulCreate

Created pod: e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

openshift-ingress

deployment-controller

e2e-noten-e7c6aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-e7c6aa-openshift-default-dd66d99b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-e73aab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-e73aab

openshift-ingress

multus

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8

SuccessfulCreate

Created pod: e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

openshift-ingress

deployment-controller

e2e-shared-a-w2-e73aab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e73aab: serviceaccount "payload-processing-e2e-shared-a-w2-e73aab" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-e73aab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-e73aab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e73aab: serviceaccount "payload-processing-e2e-shared-a-w2-e73aab" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-06e1ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-06e1ff-openshift-default-655f494d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-06e1ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-06e1ff

openshift-ingress

replicaset-controller

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8

SuccessfulCreate

Created pod: e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

openshift-ingress

multus

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:60838->10.133.0.62:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:60838->10.133.0.62:15021: read: connection reset by peer

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-06e1ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-06e1ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-06e1ff: serviceaccount "payload-processing-e2e-shared-b-w2-06e1ff" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-06e1ff: serviceaccount "payload-processing-e2e-shared-b-w2-06e1ff" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-5eef90-546c7855bf-ptrcl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-5eef90-5cf6d7d898-fkdbk

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-5eef90-openshift-default-5545bdc57d-vb22c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-12f2a92f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-12f2a92f-openshift-default-6b8f9ccb56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-12f2a92f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-12f2a92f

openshift-ingress

replicaset-controller

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56

SuccessfulCreate

Created pod: e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

openshift-ingress

multus

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-12f2a92f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-12f2a92f-6496b94986 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-12f2a92f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-12f2a92f-84bff4b99c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-12f2a92f-6496b94986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-12f2a92f-84bff4b99c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-12f2a92f-84bff4b99c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-12f2a92f: serviceaccount "payload-processing-e2e-mt-12f2a92f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-12f2a92f-84bff4b99c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-12f2a92f-6496b94986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-12f2a92f-6496b94986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-12f2a92f: serviceaccount "payload-processing-e2e-mt-12f2a92f" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-423e6a-6579667cfd-r9vmv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-423e6a-67ccc6f49c-bzv7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-e7c6aa-openshift-default-dd66d99b6-zb4sm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-423e6a-openshift-default-766d9b8f86-c2dbx

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-615c6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-615c6f

openshift-ingress

deployment-controller

e2e-shared-a-w3-615c6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd

SuccessfulCreate

Created pod: e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

openshift-ingress

multus

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-615c6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-615c6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-615c6f: serviceaccount "payload-processing-e2e-shared-a-w3-615c6f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-615c6f: serviceaccount "payload-processing-e2e-shared-a-w3-615c6f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b

SuccessfulCreate

Created pod: e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

openshift-ingress

multus

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-0b5d4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-0b5d4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-0b5d4c
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0b5d4c: serviceaccount "payload-processing-e2e-shared-b-w3-0b5d4c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-0b5d4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0b5d4c: serviceaccount "payload-processing-e2e-shared-b-w3-0b5d4c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-0b5d4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12f2a92f-84bff4b99c-l8lsv

Unhealthy

Readiness probe failed: dial tcp 10.132.0.57:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12f2a92f-6496b94986-b8922

Unhealthy

Readiness probe failed: dial tcp 10.132.0.56:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-12f2a92f-openshift-default-6b8f9ccb56-nmsdh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-1e8973-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1e8973-openshift-default-7f5f4b4894 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-1e8973

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1e8973

openshift-ingress

replicaset-controller

e2e-api-a-1e8973-openshift-default-7f5f4b4894

SuccessfulCreate

Created pod: e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

openshift-ingress

multus

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1e8973: serviceaccount "payload-processing-e2e-api-a-1e8973" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1e8973

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1e8973

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1e8973-f988f6d57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1e8973-f988f6d57

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1e8973-f988f6d57

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1e8973-f988f6d57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1e8973: serviceaccount "payload-processing-e2e-api-a-1e8973" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-0622e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0622e2

openshift-ingress

deployment-controller

e2e-api-b-0622e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0622e2-openshift-default-786bc9d79b from 0 to 1

openshift-ingress

multus

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-0622e2-openshift-default-786bc9d79b

SuccessfulCreate

Created pod: e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0622e2: serviceaccount "payload-processing-e2e-api-b-0622e2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0622e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0622e2-6d9748996c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0622e2-6d9748996c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0622e2-6d9748996c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0622e2: serviceaccount "payload-processing-e2e-api-b-0622e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0622e2-6d9748996c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0622e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d36b91-5449797478-qdsjx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d36b91-6747cb4dd5-k4hnf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-d36b91-openshift-default-75b96fb6c4-tcgvd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1e8973-6d5d9c9f66-w58rq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1e8973-f988f6d57-wgkwt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-1e8973

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-1e8973: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-1e8973": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-1e8973, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f9eda96b-88f5-43d7-9d3c-dda2f47728c7, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-a-1e8973-openshift-default-7f5f4b4894-chwkc

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0622e2-7f4cc4664b-2jft4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0622e2-6d9748996c-xrwrn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-0622e2-openshift-default-786bc9d79b-87tk5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e73aab-6678d9b6cf-6rqh2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e73aab-7f86bb8d78-5q7mc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-e73aab-openshift-default-66c44f9cb8-t44b9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-06e1ff-7fcb75bf8-4qmjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-06e1ff-768dd8d94c-8t6lm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-06e1ff-openshift-default-655f494d8-htk7d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-47e41c-868d5c966-km89k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-47e41c-5d75b77d59-hzmhl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-47e41c-openshift-default-7b648cdf56-g2ffk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-7c0011-openshift-default-78695b9686

SuccessfulCreate

Created pod: e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

openshift-ingress

deployment-controller

e2e-ipp-a-7c0011-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7c0011-openshift-default-78695b9686 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7c0011

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7c0011

openshift-ingress

multus

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7c0011

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7c0011: serviceaccount "payload-processing-e2e-ipp-a-7c0011" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7c0011

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7c0011-649d4b577c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7c0011-649d4b577c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7c0011-649d4b577c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7c0011-649d4b577c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7c0011: serviceaccount "payload-processing-e2e-ipp-a-7c0011" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Unhealthy

Readiness probe failed: Get "http://10.133.0.87:15021/healthz/ready": read tcp 10.133.0.2:57422->10.133.0.87:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

ProbeError

Readiness probe error: Get "http://10.133.0.87:15021/healthz/ready": read tcp 10.133.0.2:57422->10.133.0.87:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-7d51a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7d51a3-openshift-default-857c487d78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-7d51a3-openshift-default-857c487d78

SuccessfulCreate

Created pod: e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7d51a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7d51a3

openshift-ingress

multus

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7d51a3: serviceaccount "payload-processing-e2e-ipp-b-7d51a3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7d51a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7d51a3-54584bdd45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7d51a3-54584bdd45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7d51a3-54584bdd45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7d51a3-54584bdd45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7d51a3: serviceaccount "payload-processing-e2e-ipp-b-7d51a3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7d51a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-5fc36f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-5fc36f

openshift-ingress

deployment-controller

e2e-ipp-cleanup-5fc36f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-5fc36f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5fc36f: serviceaccount "payload-processing-e2e-ipp-cleanup-5fc36f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-5fc36f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5fc36f: serviceaccount "payload-processing-e2e-ipp-cleanup-5fc36f" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Unhealthy

Readiness probe failed: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

ProbeError

Readiness probe error: Get "http://10.133.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Created

Created container: istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-5fc36f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fc36f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-5fc36f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fc36f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c2c12dc2-e404-46ed-badc-8d2bf81542ce, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fc36f-d6f97ddcd-fcb54

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fc36f-6f857bd9bf-kszjk

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ipp-cleanup-5fc36f-openshift-default-dockercfg-sb64v); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-ipp-cleanup-5fc36f-openshift-default-7bc546f5c8-kjx96

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7c0011-68cb8b69f4-cmnnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7c0011-649d4b577c-gfzmv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-7c0011-openshift-default-78695b9686-4nvfr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-7d51a3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-7d51a3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-7d51a3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-7d51a3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 842dc4c7-1d3f-4295-a52c-2037cc99b384, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7d51a3-6b7c7bd57d-4pjvc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7d51a3-54584bdd45-cxmz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-7d51a3-openshift-default-857c487d78-s7kxw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-615c6f-778b5c6b5d-qk8b7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-615c6f-6d489cd67c-twlch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-615c6f-openshift-default-9c8ddb9fd-6sfz6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0b5d4c-64bcb644c7-4bqtz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0b5d4c-58bf995786-llmv8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-0b5d4c-openshift-default-7595d5d48b-zwnkm

Killing

Stopping container istio-proxy