Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9 to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb to ip-10-0-131-165.ec2.internal

openshift-ingress

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd to ip-10-0-141-16.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52 to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6 to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g to ip-10-0-131-83.ec2.internal

openshift-ingress

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6 to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

Scheduled

Successfully assigned openshift-ingress/e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-wjf5g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-wjf5g to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656 to ip-10-0-131-83.ec2.internal

openshift-ingress

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2 to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2 to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4 to ip-10-0-131-83.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-h9gc2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-h9gc2 to ip-10-0-131-165.ec2.internal

openshift-ingress

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d to ip-10-0-131-165.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7 to ip-10-0-131-165.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx to ip-10-0-131-83.ec2.internal

openshift-ingress

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk to ip-10-0-131-83.ec2.internal

openshift-ingress

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2 to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6 to ip-10-0-131-165.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6 to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b to ip-10-0-131-83.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-8sp6t

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8sp6t to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx to ip-10-0-131-83.ec2.internal

openshift-ingress

router-default-689966656b-rqxw6

Scheduled

Successfully assigned openshift-ingress/router-default-689966656b-rqxw6 to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr to ip-10-0-141-16.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-ltztx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ltztx to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr to ip-10-0-131-83.ec2.internal

openshift-ingress

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Scheduled

Successfully assigned openshift-ingress/e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4 to ip-10-0-131-165.ec2.internal

openshift-ingress

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-8cjcd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-8cjcd to ip-10-0-131-165.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf to ip-10-0-131-83.ec2.internal

openshift-ingress

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6 to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65 to ip-10-0-141-16.ec2.internal

openshift-ingress

kube-auth-proxy-84fbdbf5bc-mwsnr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84fbdbf5bc-mwsnr to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld to ip-10-0-141-16.ec2.internal

openshift-ingress

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2 to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246 to ip-10-0-141-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x to ip-10-0-131-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk to ip-10-0-131-83.ec2.internal

openshift-ingress

kube-auth-proxy-84fbdbf5bc-4fpgg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84fbdbf5bc-4fpgg to ip-10-0-131-83.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-689966656b from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-689966656b

FailedCreate

Error creating: pods "router-default-689966656b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-689966656b

FailedCreate

Error creating: pods "router-default-689966656b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-689966656b

SuccessfulCreate

Created pod: router-default-689966656b-rqxw6

openshift-ingress

taint-eviction-controller

router-default-689966656b-rqxw6

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/router-default-689966656b-rqxw6
(x6)

openshift-ingress

kubelet

router-default-689966656b-rqxw6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-689966656b-rqxw6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-689966656b-rqxw6

Started

Started container router

openshift-ingress

kubelet

router-default-689966656b-rqxw6

Created

Created container: router

openshift-ingress

kubelet

router-default-689966656b-rqxw6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-689966656b-rqxw6

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-84fbdbf5bc from 0 to 2

openshift-ingress

multus

kube-auth-proxy-84fbdbf5bc-mwsnr

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-84fbdbf5bc

SuccessfulCreate

Created pod: kube-auth-proxy-84fbdbf5bc-mwsnr

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-4fpgg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-84fbdbf5bc

SuccessfulCreate

Created pod: kube-auth-proxy-84fbdbf5bc-4fpgg
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-84fbdbf5bc

FailedCreate

Error creating: pods "kube-auth-proxy-84fbdbf5bc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-mwsnr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-84fbdbf5bc-4fpgg

AddedInterface

Add eth0 [10.134.0.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-8sp6t

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-4fpgg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

FailedMount

MountVolume.SetUp failed for volume "cacerts" : failed to sync secret cache: timed out waiting for the condition

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-4fpgg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-4fpgg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.77s (2.77s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-mwsnr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-mwsnr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.993s (3.993s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-84fbdbf5bc-mwsnr

Started

Started container kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-8sp6t

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.855s (2.855s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.972s (2.972s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-6bfjj

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-h9gc2

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h9gc2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-h9gc2

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h9gc2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.377s (2.377s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h9gc2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-h9gc2

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-8sp6t

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8sp6t

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-ltztx

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-ltztx

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-8cjcd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-wjf5g
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-8cjcd

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8cjcd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-wjf5g

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wjf5g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8cjcd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.655s (1.655s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8cjcd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8cjcd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wjf5g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wjf5g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wjf5g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.151s (4.151s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ltztx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ltztx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ltztx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ltztx

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ltztx

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-worker-w4-662432-openshift-default-6f448cbb66

SuccessfulCreate

Created pod: e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

openshift-ingress

replicaset-controller

e2e-inf-a-6f41de-openshift-default-5d64d8b96b

SuccessfulCreate

Created pod: e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

openshift-ingress

deployment-controller

e2e-inf-a-6f41de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-6f41de-openshift-default-5d64d8b96b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-6f41de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-6f41de

openshift-ingress

replicaset-controller

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd

SuccessfulCreate

Created pod: e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

openshift-ingress

deployment-controller

e2e-worker-w0-4dda98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4dda98

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4dda98

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-662432

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-662432

openshift-ingress

deployment-controller

e2e-worker-w4-662432-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-662432-openshift-default-6f448cbb66 from 0 to 1

openshift-ingress

multus

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.289s (3.289s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-6f41de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6f41de-5d4b995b8f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-6f41de-5d4b995b8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6f41de: serviceaccount "payload-processing-e2e-inf-a-6f41de" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-6f41de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-6f41de-5d4b995b8f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-6f41de: serviceaccount "payload-processing-e2e-inf-a-6f41de" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-6f41de-5d4b995b8f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-662432

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-662432-d58d8cbdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-662432-d58d8cbdf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-662432-d58d8cbdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-662432: serviceaccount "payload-processing-e2e-worker-w4-662432" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-662432-d58d8cbdf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-662432

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-662432: serviceaccount "payload-processing-e2e-worker-w4-662432" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

openshift-ingress

deployment-controller

e2e-autores-90ea7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-90ea7d-openshift-default-6f8c8bbf7d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-90ea7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-90ea7d

openshift-ingress

replicaset-controller

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d

SuccessfulCreate

Created pod: e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4dda98

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4dda98

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4dda98-86c4d4b76c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4dda98: serviceaccount "payload-processing-e2e-worker-w0-4dda98" not found

openshift-ingress

multus

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4dda98: serviceaccount "payload-processing-e2e-worker-w0-4dda98" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.337s (1.337s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.261s (1.261s including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-b7e002c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b7e002c7

openshift-ingress

deployment-controller

e2e-ait-b7e002c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b7e002c7-openshift-default-6c9b9c79b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b7e002c7-openshift-default-6c9b9c79b

SuccessfulCreate

Created pod: e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-90ea7d-6cff96c66f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-90ea7d-6cff96c66f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-90ea7d: serviceaccount "payload-processing-e2e-autores-90ea7d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-90ea7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-90ea7d-6cff96c66f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-90ea7d-6d688dc686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-90ea7d-6d688dc686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-90ea7d: serviceaccount "payload-processing-e2e-autores-90ea7d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-90ea7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-90ea7d-6d688dc686 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-90ea7d-6d688dc686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-90ea7d-6cff96c66f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e8510f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e8510f
(x2)

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-e8510f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e8510f-openshift-default-79b4ccf46 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-e8510f-openshift-default-79b4ccf46

SuccessfulCreate

Created pod: e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

openshift-ingress

multus

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b7e002c7: serviceaccount "payload-processing-e2e-ait-b7e002c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b7e002c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b7e002c7-5b776688cf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b7e002c7-5b776688cf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b7e002c7-5b776688cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b7e002c7: serviceaccount "payload-processing-e2e-ait-b7e002c7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b7e002c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b7e002c7-5b776688cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e8510f: serviceaccount "payload-processing-e2e-inf-b-e8510f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e8510f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e8510f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e8510f-69fb7888d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e8510f-69fb7888d9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e8510f-69fb7888d9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e8510f-69fb7888d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e8510f: serviceaccount "payload-processing-e2e-inf-b-e8510f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b7e002c7-54b75d6db6-4tcqd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b7e002c7-5b776688cf-6jc7x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b7e002c7-openshift-default-6c9b9c79b-bx4jt

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-b88c0110-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6 from 0 to 1

openshift-ingress

multus

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-migrate-b88c0110-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b88c0110-gw

openshift-ingress

replicaset-controller

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6

SuccessfulCreate

Created pod: e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.334s (2.334s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b88c0110

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b88c0110-556d549bd6 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b88c0110

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b88c0110-556d549bd6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b88c0110-556d549bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b88c0110: serviceaccount "payload-processing-e2e-migrate-b88c0110" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b88c0110-556d549bd6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

openshift-ingress

kubelet

payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b88c0110: serviceaccount "payload-processing-e2e-migrate-b88c0110" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-b88c0110-556d549bd6-w5kr2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b88c0110-68c5d57bd6-vm4wt

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-c6d0650c-openshift-default-69cdfdd6db

SuccessfulCreate

Created pod: e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

openshift-ingress

kubelet

e2e-migrate-b88c0110-gw-openshift-default-9d8dc7cf6-9pkn6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-c6d0650c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c6d0650c

openshift-ingress

deployment-controller

e2e-ait-c6d0650c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c6d0650c-openshift-default-69cdfdd6db from 0 to 1

openshift-ingress

multus

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c6d0650c-7d645f844f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c6d0650c-7d645f844f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c6d0650c-7d645f844f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c6d0650c: serviceaccount "payload-processing-e2e-ait-c6d0650c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c6d0650c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c6d0650c: serviceaccount "payload-processing-e2e-ait-c6d0650c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c6d0650c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c6d0650c-7d645f844f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c6d0650c-86cff8bbb6-vcspc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c6d0650c-7d645f844f-8tprw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-c6d0650c-openshift-default-69cdfdd6db-q5dcn

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-0c558678-openshift-default-6f8bd4b58d

SuccessfulCreate

Created pod: e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

openshift-ingress

deployment-controller

e2e-derive-0c558678-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0c558678-openshift-default-6f8bd4b58d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-0c558678

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0c558678

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0c558678

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0c558678-6d7cfc8989 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0c558678-7c67448d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0c558678-7c67448d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0c558678: serviceaccount "payload-processing-e2e-derive-0c558678" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0c558678-6d7cfc8989

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0c558678-6d7cfc8989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0c558678: serviceaccount "payload-processing-e2e-derive-0c558678" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0c558678-6d7cfc8989

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0c558678-7c67448d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0c558678

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0c558678-7c67448d9d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0c558678-7c67448d9d-nvzf2

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-0c558678

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-0c558678: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-0c558678": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-0c558678, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d7a81c8c-6b49-481a-a9c0-805faee2bd3b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-0c558678-6d7cfc8989-8nfbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-0c558678-openshift-default-dockercfg-74f75); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-0c558678-openshift-default-6f8bd4b58d-sbp7b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-90ea7d-6cff96c66f-jh8c6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-90ea7d-6d688dc686-hfpfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-16ae98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-16ae98-openshift-default-64db49fbcb from 0 to 1

openshift-ingress

multus

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-16ae98-openshift-default-64db49fbcb

SuccessfulCreate

Created pod: e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

openshift-ingress

gateway_labeler_controller

e2e-explicit-16ae98

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-16ae98

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-90ea7d-openshift-default-6f8c8bbf7d-v2vr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-16ae98

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-16ae98-65747c8f97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-16ae98-65747c8f97

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-16ae98-65747c8f97

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-16ae98-65747c8f97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-16ae98: serviceaccount "payload-processing-e2e-explicit-16ae98" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-16ae98-8b4d759db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-16ae98

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-16ae98-8b4d759db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-16ae98-8b4d759db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-16ae98-8b4d759db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-16ae98: serviceaccount "payload-processing-e2e-explicit-16ae98" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-6498ead1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6498ead1-openshift-default-7585bd6b64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6498ead1-openshift-default-7585bd6b64

SuccessfulCreate

Created pod: e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

openshift-ingress

gateway_labeler_controller

e2e-mt-6498ead1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6498ead1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6498ead1-84f85ff7b9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6498ead1-84f85ff7b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6498ead1: serviceaccount "payload-processing-e2e-mt-6498ead1" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6498ead1-5dd75db98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6498ead1-5dd75db98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6498ead1: serviceaccount "payload-processing-e2e-mt-6498ead1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6498ead1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6498ead1-5dd75db98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6498ead1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6498ead1-84f85ff7b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6498ead1-84f85ff7b9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6498ead1-5dd75db98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-6498ead1-84f85ff7b9-gdh52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6498ead1-5dd75db98-vc4ld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6498ead1-openshift-default-7585bd6b64-728nl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4

SuccessfulCreate

Created pod: e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

openshift-ingress

deployment-controller

e2e-shared-a-w2-ee98a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ee98a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ee98a5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ee98a5: serviceaccount "payload-processing-e2e-shared-a-w2-ee98a5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ee98a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ee98a5: serviceaccount "payload-processing-e2e-shared-a-w2-ee98a5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ee98a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d

SuccessfulCreate

Created pod: e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

openshift-ingress

deployment-controller

e2e-shared-b-w2-8737d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-8737d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-8737d2

openshift-ingress

multus

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-8737d2-559886fddf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-8737d2-559886fddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-8737d2: serviceaccount "payload-processing-e2e-shared-b-w2-8737d2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-8737d2-559886fddf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-8737d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-8737d2-559886fddf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-8737d2: serviceaccount "payload-processing-e2e-shared-b-w2-8737d2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-8737d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-16ae98-65747c8f97-dwvfj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-16ae98-8b4d759db-mx246

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-d91d95b4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d91d95b4

openshift-ingress

multus

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-d91d95b4-openshift-default-c7c99c4cb

SuccessfulCreate

Created pod: e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

openshift-ingress

deployment-controller

e2e-mt-d91d95b4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d91d95b4-openshift-default-c7c99c4cb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d91d95b4-b6b49c5c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d91d95b4: serviceaccount "payload-processing-e2e-mt-d91d95b4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d91d95b4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d91d95b4-b6b49c5c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d91d95b4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d91d95b4-784dfcc994 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d91d95b4-b6b49c5c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d91d95b4-b6b49c5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d91d95b4: serviceaccount "payload-processing-e2e-mt-d91d95b4" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-16ae98-openshift-default-64db49fbcb-fpv65

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-af5e21-openshift-default-8dc8b5fb

SuccessfulCreate

Created pod: e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

openshift-ingress

gateway_labeler_controller

e2e-noten-af5e21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-af5e21

openshift-ingress

deployment-controller

e2e-noten-af5e21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-af5e21-openshift-default-8dc8b5fb from 0 to 1

openshift-ingress

multus

e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-6f41de-c7bc9ff46-sknfk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-6f41de-5d4b995b8f-t9nb7

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-6f41de-openshift-default-5d64d8b96b-594vb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e8510f-69fb7888d9-4z4xx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e8510f-7bf4f85c4b-g7656

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-e8510f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-e8510f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-e8510f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-e8510f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 16bcb782-8320-4dcb-b5f1-e488edd2f56b, UID in object meta:

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-f9c9b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f9c9b8

openshift-ingress

deployment-controller

e2e-shared-a-w3-f9c9b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558

SuccessfulCreate

Created pod: e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

openshift-ingress

multus

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-e8510f-openshift-default-79b4ccf46-x6jmk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-f9c9b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f9c9b8: serviceaccount "payload-processing-e2e-shared-a-w3-f9c9b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-f9c9b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f9c9b8: serviceaccount "payload-processing-e2e-shared-a-w3-f9c9b8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e65cc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e65cc4

openshift-ingress

multus

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-e65cc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e65cc4-openshift-default-85f6765db from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db

SuccessfulCreate

Created pod: e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e65cc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e65cc4-976459b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e65cc4-976459b9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e65cc4-976459b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e65cc4: serviceaccount "payload-processing-e2e-shared-b-w3-e65cc4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e65cc4-976459b9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e65cc4: serviceaccount "payload-processing-e2e-shared-b-w3-e65cc4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e65cc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-noten-af5e21-openshift-default-8dc8b5fb-spm6s

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d91d95b4-784dfcc994-rfj7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d91d95b4-b6b49c5c-dlbdv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-d91d95b4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-d91d95b4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-d91d95b4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-d91d95b4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b777a824-a571-4ae6-a265-5fb60bfd83bd, UID in object meta:

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-d91d95b4-openshift-default-c7c99c4cb-zh6ng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-66b561-openshift-default-5989d76d4d

SuccessfulCreate

Created pod: e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

openshift-ingress

deployment-controller

e2e-api-a-66b561-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-66b561-openshift-default-5989d76d4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-66b561

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-66b561

openshift-ingress

multus

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-66b561: serviceaccount "payload-processing-e2e-api-a-66b561" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-66b561

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-66b561-777c4cf599

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-66b561-777c4cf599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-66b561: serviceaccount "payload-processing-e2e-api-a-66b561" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-66b561-777c4cf599

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-66b561

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-66b561-777c4cf599 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

openshift-ingress

kubelet

payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-41abff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-41abff

openshift-ingress

replicaset-controller

e2e-api-b-41abff-openshift-default-7bcbf6cb7d

SuccessfulCreate

Created pod: e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

openshift-ingress

deployment-controller

e2e-api-b-41abff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-41abff-openshift-default-7bcbf6cb7d from 0 to 1

openshift-ingress

multus

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-41abff-f5d88bcb9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-41abff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-41abff: serviceaccount "payload-processing-e2e-api-b-41abff" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-41abff-f5d88bcb9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-41abff-f5d88bcb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-41abff: serviceaccount "payload-processing-e2e-api-b-41abff" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-41abff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-41abff-f5d88bcb9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-66b561-777c4cf599-gdgkx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-66b561-7f9bc4f69d-rts9s

Unhealthy

Readiness probe failed: dial tcp 10.132.0.84:9004: i/o timeout
(x5)

openshift-ingress

kubelet

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-66b561-openshift-default-5989d76d4d-6kgt4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-41abff-f5d88bcb9-nkzbb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-41abff-cf5f6cc8b-cw5jp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4dda98-7449b5f466-s7wtm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4dda98-86c4d4b76c-cxmlx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-41abff-openshift-default-7bcbf6cb7d-4k59b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-4dda98-openshift-default-68fcd4ccdd-v778d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ee98a5-5859df9cf4-772p6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ee98a5-6c8d57fcf5-wh9sr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-ee98a5-openshift-default-59f976f6b4-hv9fh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-8737d2-559886fddf-dq2xh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-8737d2-74fb4565f8-j6kr6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-8737d2-openshift-default-6fd4f95d-vdkgt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-662432-d58d8cbdf-pczxx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-662432

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-662432: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-662432": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-662432, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4e68edc5-9fab-48d2-a086-21f4a538585a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-662432-8cc9b77f8-pc24x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-662432-openshift-default-6f448cbb66-bxxvd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-6a532e-openshift-default-5bbd57667d

SuccessfulCreate

Created pod: e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

openshift-ingress

deployment-controller

e2e-ipp-a-6a532e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6a532e-openshift-default-5bbd57667d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6a532e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6a532e

openshift-ingress

multus

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6a532e: serviceaccount "payload-processing-e2e-ipp-a-6a532e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6a532e-df56595b5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6a532e-df56595b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6a532e: serviceaccount "payload-processing-e2e-ipp-a-6a532e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6a532e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6a532e-df56595b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6a532e-df56595b5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6a532e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a0f152

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a0f152

openshift-ingress

deployment-controller

e2e-ipp-b-a0f152-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a0f152-openshift-default-d7f6d796b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a0f152-openshift-default-d7f6d796b

SuccessfulCreate

Created pod: e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

openshift-ingress

multus

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a0f152

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a0f152

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a0f152-5fd487bdfc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a0f152: serviceaccount "payload-processing-e2e-ipp-b-a0f152" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a0f152: serviceaccount "payload-processing-e2e-ipp-b-a0f152" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Unhealthy

Readiness probe failed: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

ProbeError

Readiness probe error: Get "http://10.134.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-0e536c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-0e536c

openshift-ingress

multus

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-0e536c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-0e536c-openshift-default-586f458df6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-0e536c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-0e536c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-0e536c: serviceaccount "payload-processing-e2e-ipp-cleanup-0e536c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-0e536c: serviceaccount "payload-processing-e2e-ipp-cleanup-0e536c" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-0e536c-948d6f9f5-d2lzf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-0e536c-84fcb48fd-xb2pg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-0e536c-openshift-default-586f458df6-ljcsd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6a532e-5b965b8874-5vl9g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6a532e-df56595b5-p4kvr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-6a532e-openshift-default-5bbd57667d-scf2c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a0f152-5cd548dbb6-r6xk9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a0f152-5fd487bdfc-jfgxp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a0f152-openshift-default-d7f6d796b-nltqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f9c9b8-5b959ffcd6-gtjg6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f9c9b8-57b45f885c-2hpcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-f9c9b8-openshift-default-fb7d4b558-sh8v2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e65cc4-976459b9-kcggk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e65cc4-5cdfb9dff8-7ghvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-e65cc4-openshift-default-85f6765db-d7rb2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: