Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Scheduled

Successfully assigned openshift-ingress/e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp to ip-10-0-139-116.ec2.internal

openshift-ingress

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2 to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-944c275f-openshift-default-7d56f79856-5skm8 to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt to ip-10-0-142-54.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb to ip-10-0-139-116.ec2.internal

openshift-ingress

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6 to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7 to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7 to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27 to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82 to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-6lkql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-6lkql to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-noten-849a35-openshift-default-6658f6b56-spdg6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-849a35-openshift-default-6658f6b56-spdg6 to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8 to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq to ip-10-0-139-116.ec2.internal

openshift-ingress

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7frsd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7frsd to ip-10-0-131-95.ec2.internal

openshift-ingress

kube-auth-proxy-59bc95f796-6kfg5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59bc95f796-6kfg5 to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84 to ip-10-0-139-116.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bjh6j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bjh6j to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4 to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5 to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-ait-2b418982-98c6875cf-d446h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-2b418982-98c6875cf-d446h to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h to ip-10-0-139-116.ec2.internal

openshift-ingress

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2 to ip-10-0-142-54.ec2.internal

openshift-ingress

router-default-d486bd584-zz2nb

Scheduled

Successfully assigned openshift-ingress/router-default-d486bd584-zz2nb to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5 to ip-10-0-142-54.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w6hn5 to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2 to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn to ip-10-0-142-54.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Scheduled

Successfully assigned openshift-ingress/e2e-autores-e114ba-openshift-default-844c8bc678-gzphs to ip-10-0-139-116.ec2.internal

openshift-ingress

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5 to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9 to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7 to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8 to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp to ip-10-0-131-95.ec2.internal

openshift-ingress

kube-auth-proxy-59bc95f796-gmfhw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59bc95f796-gmfhw to ip-10-0-142-54.ec2.internal

openshift-ingress

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x to ip-10-0-139-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c to ip-10-0-139-116.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-7pdsq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-7pdsq to ip-10-0-131-95.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh to ip-10-0-131-95.ec2.internal

openshift-ingress

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx to ip-10-0-139-116.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-d486bd584 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-d486bd584

FailedCreate

Error creating: pods "router-default-d486bd584-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-d486bd584

FailedCreate

Error creating: pods "router-default-d486bd584-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-d486bd584

SuccessfulCreate

Created pod: router-default-d486bd584-zz2nb
(x6)

openshift-ingress

kubelet

router-default-d486bd584-zz2nb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-d486bd584-zz2nb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-d486bd584-zz2nb

Started

Started container router

openshift-ingress

kubelet

router-default-d486bd584-zz2nb

Created

Created container: router

openshift-ingress

kubelet

router-default-d486bd584-zz2nb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-d486bd584-zz2nb

AddedInterface

Add eth0 [10.133.0.14/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-59bc95f796

SuccessfulCreate

Created pod: kube-auth-proxy-59bc95f796-6kfg5

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-59bc95f796 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-59bc95f796

FailedCreate

Error creating: pods "kube-auth-proxy-59bc95f796-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-59bc95f796-gmfhw

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-59bc95f796

SuccessfulCreate

Created pod: kube-auth-proxy-59bc95f796-gmfhw

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-gmfhw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-6kfg5

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-59bc95f796-6kfg5

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bjh6j

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-6kfg5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bjh6j

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-6kfg5

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-6kfg5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.402s (2.402s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-gmfhw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-gmfhw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-gmfhw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.584s (2.584s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59bc95f796-6kfg5

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.359s (3.359s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

Started

Started container discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-c64rb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.803s (2.803s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7pdsq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7pdsq

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-7pdsq

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-7pdsq

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7pdsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7pdsq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7pdsq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bjh6j

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bjh6j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-w6hn5

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-6lkql

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7frsd
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7frsd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-7frsd

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-6lkql

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkql

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkql

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkql

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkql

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.126s (2.126s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7frsd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.353s (2.353s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7frsd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7frsd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-w6hn5

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-2fab1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2fab1f-openshift-default-5448555ccb from 0 to 1

openshift-ingress

multus

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-9bd868-openshift-default-748cb6dd54

SuccessfulCreate

Created pod: e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

openshift-ingress

deployment-controller

e2e-worker-w0-9bd868-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-9bd868-openshift-default-748cb6dd54 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-9bd868

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-9bd868

openshift-ingress

multus

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-2fab1f-openshift-default-5448555ccb

SuccessfulCreate

Created pod: e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-2fab1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-2fab1f

openshift-ingress

gateway_labeler_controller

e2e-inf-a-0eb0ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-0eb0ef

openshift-ingress

deployment-controller

e2e-inf-a-0eb0ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-0eb0ef-openshift-default-7b6fd79698 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698

SuccessfulCreate

Created pod: e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

openshift-ingress

multus

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-2fab1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2fab1f: serviceaccount "payload-processing-e2e-worker-w4-2fab1f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-2fab1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2fab1f: serviceaccount "payload-processing-e2e-worker-w4-2fab1f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-9bd868: serviceaccount "payload-processing-e2e-worker-w0-9bd868" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-9bd868-549b8c464f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-9bd868-549b8c464f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-9bd868: serviceaccount "payload-processing-e2e-worker-w0-9bd868" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-9bd868

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-9bd868

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-9bd868-549b8c464f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-9bd868-549b8c464f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0eb0ef: serviceaccount "payload-processing-e2e-inf-a-0eb0ef" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-0eb0ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-0eb0ef: serviceaccount "payload-processing-e2e-inf-a-0eb0ef" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-0eb0ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-9f77ab79-openshift-default-8476f965fb

SuccessfulCreate

Created pod: e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

openshift-ingress

gateway_labeler_controller

e2e-ait-9f77ab79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9f77ab79

openshift-ingress

deployment-controller

e2e-ait-9f77ab79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9f77ab79-openshift-default-8476f965fb from 0 to 1

openshift-ingress

multus

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-e114ba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-e114ba-openshift-default-844c8bc678 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-e114ba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-e114ba

openshift-ingress

replicaset-controller

e2e-autores-e114ba-openshift-default-844c8bc678

SuccessfulCreate

Created pod: e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

openshift-ingress

multus

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9f77ab79: serviceaccount "payload-processing-e2e-ait-9f77ab79" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9f77ab79-684cf5db7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9f77ab79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9f77ab79-54769cf47d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9f77ab79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9f77ab79-684cf5db7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9f77ab79-684cf5db7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9f77ab79-684cf5db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9f77ab79: serviceaccount "payload-processing-e2e-ait-9f77ab79" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-1358dc

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-1358dc-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-1358dc-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd

SuccessfulCreate

Created pod: e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

openshift-ingress

gateway_labeler_controller

e2e-inf-b-1358dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-1358dc

openshift-ingress

deployment-controller

e2e-inf-b-1358dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-1358dc-openshift-default-55bfdbd7dd from 0 to 1

openshift-ingress

multus

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-e114ba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-e114ba-7dcd6db77 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e114ba-65c4b7655d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-e114ba-65c4b7655d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e114ba: serviceaccount "payload-processing-e2e-autores-e114ba" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e114ba-65c4b7655d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e114ba-7dcd6db77

SuccessfulCreate

Created pod: payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-e114ba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-e114ba-65c4b7655d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e114ba-7dcd6db77

FailedCreate

Error creating: pods "payload-processing-e2e-autores-e114ba-7dcd6db77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e114ba: serviceaccount "payload-processing-e2e-autores-e114ba" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1358dc: serviceaccount "payload-processing-e2e-inf-b-1358dc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-1358dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-1358dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-1358dc-7c587f6458 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1358dc: serviceaccount "payload-processing-e2e-inf-b-1358dc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-9f77ab79-684cf5db7-n62j2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9f77ab79-54769cf47d-hnljl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9f77ab79-openshift-default-8476f965fb-gwsqs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-fc7a9035-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-fc7a9035-gw

openshift-ingress

replicaset-controller

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96

SuccessfulCreate

Created pod: e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

openshift-ingress

deployment-controller

e2e-migrate-fc7a9035-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96 from 0 to 1

openshift-ingress

multus

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-fc7a9035

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-fc7a9035-547c5d7b66 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fc7a9035: serviceaccount "payload-processing-e2e-migrate-fc7a9035" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fc7a9035-547c5d7b66

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-fc7a9035-547c5d7b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fc7a9035: serviceaccount "payload-processing-e2e-migrate-fc7a9035" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-fc7a9035

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-fc7a9035-6b57977598 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

openshift-ingress

multus

payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fc7a9035-547c5d7b66

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

openshift-ingress

kubelet

payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fc7a9035-6b57977598-w79n4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-fc7a9035-547c5d7b66-svwl2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-fc7a9035

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-fc7a9035": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-fc7a9035, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0c16f495-bdb2-4514-be15-b1770d469191, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-fc7a9035-gw-openshift-default-6f4746db96-n2j9b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-2b418982

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-2b418982

openshift-ingress

replicaset-controller

e2e-ait-2b418982-openshift-default-84c455fc9b

SuccessfulCreate

Created pod: e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

openshift-ingress

deployment-controller

e2e-ait-2b418982-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-2b418982-openshift-default-84c455fc9b from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-ait-2b418982

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-2b418982-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-2b418982-authn-ssl" already exists

openshift-ingress

multus

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-2b418982-98c6875cf-d446h

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b418982-98c6875cf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-2b418982-98c6875cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b418982: serviceaccount "payload-processing-e2e-ait-2b418982" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-2b418982-98c6875cf-d446h

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-2b418982-98c6875cf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-2b418982-98c6875cf-d446h

openshift-ingress

kubelet

payload-processing-e2e-ait-2b418982-98c6875cf-d446h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-2b418982

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-2b418982-98c6875cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-2b418982-98c6875cf-d446h

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b418982-55c46d788b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-2b418982-55c46d788b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-2b418982: serviceaccount "payload-processing-e2e-ait-2b418982" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-2b418982-55c46d788b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-2b418982

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-2b418982-55c46d788b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-2b418982-98c6875cf-d446h

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-2b418982-55c46d788b-wt27k

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-2b418982

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-2b418982: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-2b418982": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-2b418982, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9c008f16-4885-4794-a5c5-e7d51f857f8b, UID in object meta:

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-2b418982-openshift-default-dockercfg-bt2q2); attempting to pull the image may not succeed.

openshift-ingress

gateway_labeler_controller

e2e-derive-ed7d9f67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ed7d9f67

openshift-ingress

kubelet

e2e-ait-2b418982-openshift-default-84c455fc9b-fp8bs

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-derive-ed7d9f67

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-derive-ed7d9f67-authn-ssl: envoyfilters.networking.istio.io "e2e-derive-ed7d9f67-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-derive-ed7d9f67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ed7d9f67-openshift-default-77cf774796 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-ed7d9f67-openshift-default-77cf774796

SuccessfulCreate

Created pod: e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

openshift-ingress

multus

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ed7d9f67

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ed7d9f67-775558d5d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ed7d9f67

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ed7d9f67-54c759486b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ed7d9f67: serviceaccount "payload-processing-e2e-derive-ed7d9f67" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ed7d9f67-775558d5d5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ed7d9f67-775558d5d5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ed7d9f67-775558d5d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ed7d9f67: serviceaccount "payload-processing-e2e-derive-ed7d9f67" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e114ba-65c4b7655d-cpblh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e114ba-7dcd6db77-z2v27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-ed7d9f67-775558d5d5-csh5b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ed7d9f67-54c759486b-gw99c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-ed7d9f67-openshift-default-77cf774796-dvj7c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-e114ba-openshift-default-844c8bc678-gzphs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-a1c362

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a1c362

openshift-ingress

deployment-controller

e2e-explicit-a1c362-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a1c362-openshift-default-86b6bd6876 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-a1c362-openshift-default-86b6bd6876

SuccessfulCreate

Created pod: e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

openshift-ingress

multus

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a1c362: serviceaccount "payload-processing-e2e-explicit-a1c362" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a1c362-d47ff4df

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a1c362-d47ff4df

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a1c362-d47ff4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a1c362: serviceaccount "payload-processing-e2e-explicit-a1c362" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a1c362

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a1c362-d47ff4df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a1c362

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a1c362-58f59c57c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-53d3db96-openshift-default-75b6c8d556

SuccessfulCreate

Created pod: e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

openshift-ingress

deployment-controller

e2e-mt-53d3db96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-53d3db96-openshift-default-75b6c8d556 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-53d3db96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-53d3db96

openshift-ingress

multus

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a1c362-d47ff4df-bb7d6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a1c362-58f59c57c4-ftxv7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-53d3db96-597dfdff85

SuccessfulCreate

Created pod: payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-53d3db96-6776578494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-53d3db96-6776578494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-53d3db96-6776578494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-53d3db96: serviceaccount "payload-processing-e2e-mt-53d3db96" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-53d3db96-597dfdff85

FailedCreate

Error creating: pods "payload-processing-e2e-mt-53d3db96-597dfdff85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-53d3db96: serviceaccount "payload-processing-e2e-mt-53d3db96" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-53d3db96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-53d3db96-6776578494 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-53d3db96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-53d3db96-597dfdff85 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-849a35-openshift-default-6658f6b56

SuccessfulCreate

Created pod: e2e-noten-849a35-openshift-default-6658f6b56-spdg6

openshift-ingress

deployment-controller

e2e-noten-849a35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-849a35-openshift-default-6658f6b56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-849a35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-849a35

openshift-ingress

kubelet

e2e-noten-849a35-openshift-default-6658f6b56-spdg6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-849a35-openshift-default-6658f6b56-spdg6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-849a35-openshift-default-6658f6b56-spdg6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-849a35-openshift-default-6658f6b56-spdg6

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-a1c362-openshift-default-86b6bd6876-cjv6h

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-53d3db96-597dfdff85-x9f7m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-53d3db96-6776578494-vdp82

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-53d3db96-openshift-default-75b6c8d556-9cgqp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-01611d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-01611d

openshift-ingress

deployment-controller

e2e-shared-a-w2-01611d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4

SuccessfulCreate

Created pod: e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

openshift-ingress

multus

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-01611d: serviceaccount "payload-processing-e2e-shared-a-w2-01611d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-01611d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-01611d-579957d8c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-01611d-579957d8c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-01611d-579957d8c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-01611d-579957d8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-01611d: serviceaccount "payload-processing-e2e-shared-a-w2-01611d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-01611d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8

SuccessfulCreate

Created pod: e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

openshift-ingress

deployment-controller

e2e-shared-b-w2-4dbbbf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4dbbbf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4dbbbf

openshift-ingress

multus

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-0eb0ef

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-0eb0ef: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-0eb0ef": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-0eb0ef, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 454f5833-8208-4147-a57b-fefb4551e40e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-0eb0ef-86b49b8d6-bpsl5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-0eb0ef-55f6bf4d7c-t26fw

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4dbbbf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4dbbbf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf: serviceaccount "payload-processing-e2e-shared-b-w2-4dbbbf" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4dbbbf: serviceaccount "payload-processing-e2e-shared-b-w2-4dbbbf" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-944c275f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-944c275f

openshift-ingress

deployment-controller

e2e-mt-944c275f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-944c275f-openshift-default-7d56f79856 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-944c275f-openshift-default-7d56f79856

SuccessfulCreate

Created pod: e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

openshift-ingress

kubelet

e2e-inf-a-0eb0ef-openshift-default-7b6fd79698-lkm84

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-944c275f-dc4cbd886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-944c275f-dc4cbd886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-944c275f: serviceaccount "payload-processing-e2e-mt-944c275f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-944c275f-7587564f9c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-944c275f-7587564f9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-944c275f: serviceaccount "payload-processing-e2e-mt-944c275f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-944c275f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-944c275f-7587564f9c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-944c275f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-944c275f-dc4cbd886 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-944c275f-7587564f9c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-944c275f-dc4cbd886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

Created

Created container: payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-1358dc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-1358dc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-1358dc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-1358dc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 04f36761-09bb-4206-8649-ff92dc11cf02, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1358dc-7c587f6458-p5knh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1358dc-7cdc6bdc5f-nn2lt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-849a35-openshift-default-6658f6b56-spdg6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": read tcp 10.132.0.2:37290->10.132.0.84:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": read tcp 10.132.0.2:37290->10.132.0.84:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678

SuccessfulCreate

Created pod: e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

openshift-ingress

deployment-controller

e2e-shared-a-w3-26f1b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-26f1b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-26f1b0

openshift-ingress

multus

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-1358dc-openshift-default-55bfdbd7dd-cc5dx

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-26f1b0: serviceaccount "payload-processing-e2e-shared-a-w3-26f1b0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-26f1b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-26f1b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-26f1b0: serviceaccount "payload-processing-e2e-shared-a-w3-26f1b0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b

SuccessfulCreate

Created pod: e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

openshift-ingress

deployment-controller

e2e-shared-b-w3-dd6959-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-dd6959

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-dd6959

openshift-ingress

multus

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959: serviceaccount "payload-processing-e2e-shared-b-w3-dd6959" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-dd6959

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-dd6959

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-dd6959: serviceaccount "payload-processing-e2e-shared-b-w3-dd6959" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-944c275f-dc4cbd886-tnv9k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-944c275f-7587564f9c-gz7h7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-944c275f-openshift-default-7d56f79856-5skm8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-01df46

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-01df46

openshift-ingress

replicaset-controller

e2e-api-a-01df46-openshift-default-854d75b8db

SuccessfulCreate

Created pod: e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

openshift-ingress

deployment-controller

e2e-api-a-01df46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-01df46-openshift-default-854d75b8db from 0 to 1

openshift-ingress

multus

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-01df46-64ff4f954f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-01df46-64ff4f954f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-01df46: serviceaccount "payload-processing-e2e-api-a-01df46" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-01df46: serviceaccount "payload-processing-e2e-api-a-01df46" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-01df46

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-01df46

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-01df46-64ff4f954f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-01df46-64ff4f954f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-b-f3e7da-openshift-default-5574b5f5d6

SuccessfulCreate

Created pod: e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

openshift-ingress

deployment-controller

e2e-api-b-f3e7da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f3e7da-openshift-default-5574b5f5d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-f3e7da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f3e7da

openshift-ingress

multus

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f3e7da: serviceaccount "payload-processing-e2e-api-b-f3e7da" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f3e7da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f3e7da-5f4fbbfb57 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f3e7da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f3e7da: serviceaccount "payload-processing-e2e-api-b-f3e7da" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn
(x2)

openshift-ingress

kubelet

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-01df46-64ff4f954f-cfj7b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-01df46-6cbbfc8cc4-fqss7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

Unhealthy

Readiness probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-01df46-openshift-default-854d75b8db-jtp2h

ProbeError

Readiness probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-9bd868-5c9d559666-rdllt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-9bd868

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-9bd868: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-9bd868": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-9bd868, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6270b2b3-ce6b-468c-bb2b-ce61856ca952, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-9bd868-549b8c464f-5v9f5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f3e7da-97bcf6dc8-t58kn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f3e7da-5f4fbbfb57-fldzl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-9bd868-openshift-default-748cb6dd54-wp7lh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f3e7da-openshift-default-5574b5f5d6-qj4vn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-01611d-ff4d64f4-5khg8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-01611d-579957d8c5-7p9ng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-01611d-openshift-default-6b99d5c8b4-f9pvq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4dbbbf-67975c844b-vfjtb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4dbbbf-6f4df66675-fsnq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4dbbbf-openshift-default-7d979866d8-sc2hq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2fab1f-7dd4d6894c-qgvnp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2fab1f-5699b676fd-slfsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-2fab1f-openshift-default-5448555ccb-48c6x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b

SuccessfulCreate

Created pod: e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

openshift-ingress

deployment-controller

e2e-ipp-a-0ecfa6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0ecfa6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0ecfa6

openshift-ingress

multus

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0ecfa6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0ecfa6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6: serviceaccount "payload-processing-e2e-ipp-a-0ecfa6" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0ecfa6: serviceaccount "payload-processing-e2e-ipp-a-0ecfa6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-2023d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2023d5-openshift-default-56fc74d748 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-2023d5-openshift-default-56fc74d748

SuccessfulCreate

Created pod: e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2023d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2023d5

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.832s (2.832s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2023d5: serviceaccount "payload-processing-e2e-ipp-b-2023d5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2023d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2023d5-d75f87b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2023d5-d75f87b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2023d5-d75f87b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2023d5-d75f87b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2023d5: serviceaccount "payload-processing-e2e-ipp-b-2023d5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2023d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-cd36d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-cd36d2

openshift-ingress

multus

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-cd36d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-cd36d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-cd36d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2: serviceaccount "payload-processing-e2e-ipp-cleanup-cd36d2" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cd36d2: serviceaccount "payload-processing-e2e-ipp-cleanup-cd36d2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd36d2-57cd56cf8-785gh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd36d2-7c6ff6dcf5-tvnhq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cd36d2-openshift-default-84ffd599d8-phb7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0ecfa6-f58759bf4-n648f

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-0ecfa6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-0ecfa6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-0ecfa6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-0ecfa6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 14ef216a-7148-4b8b-b197-f27eff489750, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0ecfa6-6d5ccd847f-ngpds

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-0ecfa6-openshift-default-79bb784f5b-c2cn9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2023d5-d75f87b7-s7gcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2023d5-7cbc4496fd-bl78q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-2023d5-openshift-default-56fc74d748-cwb7q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-26f1b0-76f8c99946-qrm8n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-26f1b0-79ddcfb5c-sqrzw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-26f1b0-openshift-default-db7d9c678-v2znm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd6959-8dc57dd6c-7dzcq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd6959-5c59f85b94-76jg2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-dd6959-openshift-default-5685dd9b9b-tzjc8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503