Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6 to ip-10-0-135-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bs8q9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bs8q9 to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq to ip-10-0-128-118.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv to ip-10-0-135-244.ec2.internal

openshift-ingress

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9 to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b to ip-10-0-135-244.ec2.internal

openshift-ingress

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-ait-46484ed0-777b7d677c-zl644

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-46484ed0-777b7d677c-zl644 to ip-10-0-135-244.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-rsfpf

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-rsfpf to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8 to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4 to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9 to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7tq89

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7tq89 to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27 to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2 to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2 to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq to ip-10-0-135-244.ec2.internal

openshift-ingress

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8 to ip-10-0-139-211.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czjkjt to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8 to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8 to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt to ip-10-0-135-244.ec2.internal

openshift-ingress

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx to ip-10-0-139-211.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-h77w6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-h77w6 to ip-10-0-128-118.ec2.internal

openshift-ingress

kube-auth-proxy-7fbcb8d956-mmjvl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7fbcb8d956-mmjvl to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b9483e-openshift-default-57866d8676-pngwh to ip-10-0-128-118.ec2.internal

openshift-ingress

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq to ip-10-0-128-118.ec2.internal

openshift-ingress

kube-auth-proxy-7fbcb8d956-mkkn8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7fbcb8d956-mkkn8 to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5 to ip-10-0-139-211.ec2.internal

openshift-ingress

router-default-565d5b7686-dcqqw

Scheduled

Successfully assigned openshift-ingress/router-default-565d5b7686-dcqqw to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-f5g58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-f5g58 to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-8376bc-779c757f85-k45jf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-8376bc-779c757f85-k45jf to ip-10-0-139-211.ec2.internal

openshift-ingress

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr to ip-10-0-128-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw to ip-10-0-135-244.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56 to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66 to ip-10-0-139-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq to ip-10-0-135-244.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-565d5b7686 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-565d5b7686

FailedCreate

Error creating: pods "router-default-565d5b7686-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x17)

openshift-ingress

replicaset-controller

router-default-565d5b7686

FailedCreate

Error creating: pods "router-default-565d5b7686-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-565d5b7686

SuccessfulCreate

Created pod: router-default-565d5b7686-dcqqw
(x6)

openshift-ingress

kubelet

router-default-565d5b7686-dcqqw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-565d5b7686-dcqqw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-565d5b7686-dcqqw

Started

Started container router

openshift-ingress

kubelet

router-default-565d5b7686-dcqqw

Created

Created container: router

openshift-ingress

multus

router-default-565d5b7686-dcqqw

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-565d5b7686-dcqqw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-7fbcb8d956

FailedCreate

Error creating: pods "kube-auth-proxy-7fbcb8d956-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7fbcb8d956

SuccessfulCreate

Created pod: kube-auth-proxy-7fbcb8d956-mmjvl

openshift-ingress

replicaset-controller

kube-auth-proxy-7fbcb8d956

SuccessfulCreate

Created pod: kube-auth-proxy-7fbcb8d956-mkkn8

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7fbcb8d956 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mkkn8

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mmjvl

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mmjvl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bs8q9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bs8q9

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mkkn8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7fbcb8d956-mkkn8

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7fbcb8d956-mmjvl

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mmjvl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mkkn8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.687s (2.687s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mmjvl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.781s (2.781s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mkkn8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mmjvl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7fbcb8d956-mkkn8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 13.766s (13.766s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-rsfpf

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.922s (2.922s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rsfpf

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rsfpf

Created

Created container: discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rsfpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.579s (2.579s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czjkjt

Started

Started container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-rsfpf

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bs8q9

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bs8q9

Killing

Stopping container discovery
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-8d2sw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-h77w6

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-h77w6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f5g58

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-f5g58

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7tq89

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-f5g58

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7tq89

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-7tq89

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7tq89

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7tq89

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f5g58

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.992s (2.992s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f5g58

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f5g58

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7tq89

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.354s (2.354s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-h77w6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-h77w6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-h77w6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-h77w6

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-h77w6

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-cc0040-openshift-default-64fb775c48

SuccessfulCreate

Created pod: e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

openshift-ingress

deployment-controller

e2e-worker-w4-cc0040-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-cc0040-openshift-default-64fb775c48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd

SuccessfulCreate

Created pod: e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-cc0040

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-cc0040

openshift-ingress

deployment-controller

e2e-worker-w0-01b7d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-01b7d5-openshift-default-5c86df84cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-01b7d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-01b7d5

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f0f965

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f0f965

openshift-ingress

deployment-controller

e2e-inf-a-f0f965-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f0f965-openshift-default-7467594bf8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-f0f965-openshift-default-7467594bf8

SuccessfulCreate

Created pod: e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

openshift-ingress

multus

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f0f965

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-01b7d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-01b7d5-f985bff5c from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f0f965

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f0f965-5f649ddfcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f0f965-5f649ddfcc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f0f965-5f649ddfcc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f0f965-5f649ddfcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f0f965: serviceaccount "payload-processing-e2e-inf-a-f0f965" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f0f965: serviceaccount "payload-processing-e2e-inf-a-f0f965" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-01b7d5-f985bff5c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-01b7d5-f985bff5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-01b7d5: serviceaccount "payload-processing-e2e-worker-w0-01b7d5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-01b7d5-f985bff5c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-01b7d5: serviceaccount "payload-processing-e2e-worker-w0-01b7d5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-01b7d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-cc0040

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-cc0040: serviceaccount "payload-processing-e2e-worker-w4-cc0040" not found

openshift-ingress

gateway_labeler_controller

e2e-ait-46484ed0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-46484ed0

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-46484ed0-openshift-default-dccd56d86

SuccessfulCreate

Created pod: e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-cc0040: serviceaccount "payload-processing-e2e-worker-w4-cc0040" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-cc0040

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-ait-46484ed0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-46484ed0-openshift-default-dccd56d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

openshift-ingress

multus

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-autores-39c7cb

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-39c7cb-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-39c7cb-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-autores-39c7cb-openshift-default-68d446bf84

SuccessfulCreate

Created pod: e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

openshift-ingress

deployment-controller

e2e-autores-39c7cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-39c7cb-openshift-default-68d446bf84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-39c7cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-39c7cb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-46484ed0: serviceaccount "payload-processing-e2e-ait-46484ed0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-46484ed0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-46484ed0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-46484ed0-777b7d677c from 0 to 1

openshift-ingress

multus

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-46484ed0-777b7d677c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-46484ed0-777b7d677c-zl644
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-46484ed0-777b7d677c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-46484ed0-777b7d677c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-46484ed0: serviceaccount "payload-processing-e2e-ait-46484ed0" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-46484ed0-777b7d677c-zl644

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-46484ed0-777b7d677c-zl644

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-46484ed0-777b7d677c-zl644

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-46484ed0-777b7d677c-zl644

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-39c7cb-9694fc7dc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-39c7cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-39c7cb-659966798 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-39c7cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-39c7cb-9694fc7dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-39c7cb-9694fc7dc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-39c7cb-9694fc7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-39c7cb: serviceaccount "payload-processing-e2e-autores-39c7cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-39c7cb-659966798

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-39c7cb-659966798

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-39c7cb-659966798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-39c7cb: serviceaccount "payload-processing-e2e-autores-39c7cb" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a6d968

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a6d968

openshift-ingress

deployment-controller

e2e-inf-b-a6d968-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a6d968-openshift-default-79c94d4964 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-a6d968-openshift-default-79c94d4964

SuccessfulCreate

Created pod: e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

openshift-ingress

multus

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x8)

openshift-ingress

kubelet

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a6d968-bb6cddf55

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a6d968

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a6d968-bb6cddf55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a6d968

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a6d968-577f489cdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a6d968-bb6cddf55

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a6d968-bb6cddf55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a6d968: serviceaccount "payload-processing-e2e-inf-b-a6d968" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a6d968: serviceaccount "payload-processing-e2e-inf-b-a6d968" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-46484ed0-777b7d677c-zl644

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-46484ed0-6cc6f5fddb-b547w

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-e214cef3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e214cef3-gw-openshift-default-5f46595c64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-e214cef3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e214cef3-gw

openshift-ingress

replicaset-controller

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64

SuccessfulCreate

Created pod: e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e214cef3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e214cef3: serviceaccount "payload-processing-e2e-migrate-e214cef3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e214cef3-7b4dfb598

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e214cef3-7b4dfb598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e214cef3: serviceaccount "payload-processing-e2e-migrate-e214cef3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e214cef3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e214cef3-7b4dfb598 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

openshift-ingress

kubelet

payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e214cef3-7b4dfb598

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-46484ed0-openshift-default-dccd56d86-mrrgm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-e214cef3-7b4dfb598-hctcb

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-a2f357ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a2f357ac-openshift-default-755b75f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a2f357ac-openshift-default-755b75f6

SuccessfulCreate

Created pod: e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

openshift-ingress

gateway_labeler_controller

e2e-ait-a2f357ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a2f357ac

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e214cef3-7ccdcd8c8b-lxkrp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e214cef3-gw-openshift-default-5f46595c64-lfqvv

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a2f357ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a2f357ac-85648769bc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a2f357ac: serviceaccount "payload-processing-e2e-ait-a2f357ac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a2f357ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a2f357ac-85648769bc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a2f357ac-85648769bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a2f357ac: serviceaccount "payload-processing-e2e-ait-a2f357ac" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a2f357ac-85648769bc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

openshift-ingress

kubelet

payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt
(x2)

openshift-ingress

kubelet

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-a2f357ac-85648769bc-lr4p2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a2f357ac-b66c7dd78-cz9wt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-39c7cb-659966798-pg9xx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-39c7cb-9694fc7dc-2b7ck

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a2f357ac-openshift-default-755b75f6-hpbjr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-96c64491-openshift-default-5f8d6958dd

SuccessfulCreate

Created pod: e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

openshift-ingress

deployment-controller

e2e-derive-96c64491-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-96c64491-openshift-default-5f8d6958dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-96c64491

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-96c64491

openshift-ingress

GatewayAuthBootstrap

e2e-derive-96c64491

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-derive-96c64491-authn-ssl: envoyfilters.networking.istio.io "e2e-derive-96c64491-authn-ssl" already exists

openshift-ingress

multus

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-96c64491-6d6c447889

SuccessfulCreate

Created pod: payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-96c64491

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-96c64491-6d6c447889

FailedCreate

Error creating: pods "payload-processing-e2e-derive-96c64491-6d6c447889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-96c64491: serviceaccount "payload-processing-e2e-derive-96c64491" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-96c64491: serviceaccount "payload-processing-e2e-derive-96c64491" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-96c64491

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-96c64491-6d6c447889 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-39c7cb-openshift-default-68d446bf84-s48pr

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-explicit-8376bc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-8376bc

openshift-ingress

deployment-controller

e2e-explicit-8376bc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-8376bc-openshift-default-7c9d856dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-8376bc-openshift-default-7c9d856dd

SuccessfulCreate

Created pod: e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

openshift-ingress

multus

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-96c64491-6d6c447889-wxt7l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-96c64491-openshift-default-5f8d6958dd-zdljk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-96c64491-7fcc6b76cd-g8lf5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8376bc-779c757f85-k45jf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8376bc-779c757f85-k45jf

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-8376bc-779c757f85-k45jf

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-8376bc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-8376bc-775c647d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8376bc-775c647d86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-8376bc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-8376bc-779c757f85 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8376bc-775c647d86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-8376bc-775c647d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8376bc: serviceaccount "payload-processing-e2e-explicit-8376bc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8376bc-779c757f85

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-8376bc-779c757f85-k45jf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8376bc-779c757f85

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-8376bc-779c757f85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8376bc: serviceaccount "payload-processing-e2e-explicit-8376bc" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-8376bc-779c757f85-k45jf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": read tcp 10.133.0.2:57450->10.133.0.56:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": read tcp 10.133.0.2:57450->10.133.0.56:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-cb0fe265-openshift-default-755bf65cb4

SuccessfulCreate

Created pod: e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

openshift-ingress

deployment-controller

e2e-mt-cb0fe265-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cb0fe265-openshift-default-755bf65cb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-cb0fe265

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cb0fe265

openshift-ingress

multus

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8376bc-775c647d86-phxpq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8376bc-779c757f85-k45jf

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cb0fe265

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cb0fe265-689f768665 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cb0fe265: serviceaccount "payload-processing-e2e-mt-cb0fe265" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cb0fe265-689f768665

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cb0fe265-689f768665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cb0fe265: serviceaccount "payload-processing-e2e-mt-cb0fe265" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cb0fe265

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

openshift-ingress

kubelet

payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cb0fe265-689f768665

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

openshift-ingress

multus

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-noten-c59d42

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c59d42

openshift-ingress

deployment-controller

e2e-noten-c59d42-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c59d42-openshift-default-5bbf796f4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-c59d42-openshift-default-5bbf796f4b

SuccessfulCreate

Created pod: e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

openshift-ingress

kubelet

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-8376bc-openshift-default-7c9d856dd-ng9vq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cb0fe265-5b66d7b95d-wlp5l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cb0fe265-689f768665-vcwmc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-cb0fe265-openshift-default-755bf65cb4-4zw4m

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-1d36d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-1d36d9

openshift-ingress

deployment-controller

e2e-shared-a-w2-1d36d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-1d36d9-openshift-default-656799dcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb

SuccessfulCreate

Created pod: e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

openshift-ingress

multus

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1d36d9: serviceaccount "payload-processing-e2e-shared-a-w2-1d36d9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-1d36d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1d36d9: serviceaccount "payload-processing-e2e-shared-a-w2-1d36d9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-1d36d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-c59d42-openshift-default-5bbf796f4b-ftg9t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-870d44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-870d44-openshift-default-5474769654 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-870d44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-870d44

openshift-ingress

replicaset-controller

e2e-shared-b-w2-870d44-openshift-default-5474769654

SuccessfulCreate

Created pod: e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

openshift-ingress

multus

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f0f965-7bc76dc7c4-8nz66

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-870d44-5699647545

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-870d44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-870d44-5699647545 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-870d44-5699647545

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-870d44-5699647545-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-870d44: serviceaccount "payload-processing-e2e-shared-b-w2-870d44" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-870d44: serviceaccount "payload-processing-e2e-shared-b-w2-870d44" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-f0f965

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-f0f965: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-f0f965": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-f0f965, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ab5f9ed7-672e-4273-bc3a-35aee729c77b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f0f965-5f649ddfcc-rfmqw

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-870d44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-f0f965-openshift-default-7467594bf8-nx99p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a6d968-bb6cddf55-sg8tp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a6d968-577f489cdb-h6g56

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-1de9a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd

SuccessfulCreate

Created pod: e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1de9a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1de9a7

openshift-ingress

multus

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-a6d968-openshift-default-79c94d4964-x42k4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1de9a7: serviceaccount "payload-processing-e2e-shared-a-w3-1de9a7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1de9a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1de9a7: serviceaccount "payload-processing-e2e-shared-a-w3-1de9a7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1de9a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-557790f7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-557790f7
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-557790f7-openshift-default-7b59d5b64d

SuccessfulCreate

Created pod: e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

openshift-ingress

deployment-controller

e2e-mt-557790f7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-557790f7-openshift-default-7b59d5b64d from 0 to 1

openshift-ingress

multus

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-557790f7-5d45b9884b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-557790f7-5d45b9884b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-557790f7-5d45b9884b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-557790f7: serviceaccount "payload-processing-e2e-mt-557790f7" not found
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-557790f7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-557790f7-5d45b9884b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-557790f7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-557790f7-6f57686bbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-557790f7-6f57686bbf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-557790f7-6f57686bbf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-557790f7-6f57686bbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-557790f7: serviceaccount "payload-processing-e2e-mt-557790f7" not found

openshift-ingress

multus

payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd

SuccessfulCreate

Created pod: e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

openshift-ingress

multus

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-b1baac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b1baac-openshift-default-5485d669cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-b1baac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-b1baac

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-b1baac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b1baac: serviceaccount "payload-processing-e2e-shared-b-w3-b1baac" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-b1baac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b1baac: serviceaccount "payload-processing-e2e-shared-b-w3-b1baac" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-557790f7-6f57686bbf-p8xhv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557790f7-5d45b9884b-q4fj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-557790f7-openshift-default-7b59d5b64d-29xk8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-beac5e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-beac5e-openshift-default-6fbfcd666 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-beac5e-openshift-default-6fbfcd666

SuccessfulCreate

Created pod: e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

openshift-ingress

gateway_labeler_controller

e2e-api-a-beac5e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-beac5e

openshift-ingress

multus

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-beac5e-f654464b5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-beac5e-f654464b5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-beac5e-f654464b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-beac5e: serviceaccount "payload-processing-e2e-api-a-beac5e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-beac5e: serviceaccount "payload-processing-e2e-api-a-beac5e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-beac5e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-beac5e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-beac5e-f654464b5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-api-b-b9483e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b9483e

openshift-ingress

deployment-controller

e2e-api-b-b9483e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b9483e-openshift-default-57866d8676 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-b9483e-openshift-default-57866d8676

SuccessfulCreate

Created pod: e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

openshift-ingress

multus

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b9483e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b9483e-bfbb4cd95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b9483e-bfbb4cd95

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b9483e-bfbb4cd95

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b9483e-bfbb4cd95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9483e: serviceaccount "payload-processing-e2e-api-b-b9483e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b9483e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b9483e-c574cc78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b9483e-c574cc78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b9483e-c574cc78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b9483e-c574cc78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b9483e: serviceaccount "payload-processing-e2e-api-b-b9483e" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-beac5e-f654464b5-kvlrn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-beac5e-bcbbcf8c8-dwt9h

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-api-a-beac5e-openshift-default-6fbfcd666-tfcw8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-b9483e-bfbb4cd95-8nztq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b9483e-c574cc78-4tncw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-b9483e-openshift-default-57866d8676-pngwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1d36d9-68f47dff7d-r2lx6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1d36d9-76c84c4f5-l6jkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-1d36d9-openshift-default-656799dcb-285bw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-870d44-5699647545-6p2ph

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-870d44-5d858486c8-jwqw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-870d44-openshift-default-5474769654-2nqbs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-01b7d5-757b98865d-vxbxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-01b7d5-f985bff5c-4mxmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-01b7d5-openshift-default-5c86df84cd-fkb6h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-cc0040-97c4f67bb-rhh27

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-cc0040-b7f7ddf8c-r4qw8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-cc0040-openshift-default-64fb775c48-p42bl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-918bbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-918bbb

openshift-ingress

replicaset-controller

e2e-ipp-a-918bbb-openshift-default-5587757f94

SuccessfulCreate

Created pod: e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

openshift-ingress

deployment-controller

e2e-ipp-a-918bbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-918bbb-openshift-default-5587757f94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-918bbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-918bbb-685f64b8fc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-918bbb: serviceaccount "payload-processing-e2e-ipp-a-918bbb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-918bbb-685f64b8fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-918bbb-685f64b8fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-918bbb: serviceaccount "payload-processing-e2e-ipp-a-918bbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-918bbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-918bbb-685f64b8fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn
(x2)

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b

SuccessfulCreate

Created pod: e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

openshift-ingress

deployment-controller

e2e-ipp-b-5c9018-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-5c9018

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-5c9018

openshift-ingress

multus

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-5c9018

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c9018-6fcc79d479

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-5c9018-6fcc79d479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c9018: serviceaccount "payload-processing-e2e-ipp-b-5c9018" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-5c9018-6fcc79d479

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-5c9018

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-5c9018-6fcc79d479 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-5c9018: serviceaccount "payload-processing-e2e-ipp-b-5c9018" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-70937b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-70937b

openshift-ingress

deployment-controller

e2e-ipp-cleanup-70937b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-70937b: serviceaccount "payload-processing-e2e-ipp-cleanup-70937b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-70937b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-70937b: serviceaccount "payload-processing-e2e-ipp-cleanup-70937b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-70937b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-70937b-8b888ff94-tvhqs

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-70937b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-70937b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-70937b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-70937b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e6e186ef-cd47-41fa-afe2-5f4b289a0543, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-70937b-77b79fd9ff-5fs7z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-70937b-openshift-default-68659b8b5b-hxzkk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-918bbb-567cdb9b8b-7564x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-918bbb-685f64b8fc-5xtbn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-918bbb-openshift-default-5587757f94-pt8gg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-5c9018-5b7589b586-mtk5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-5c9018-6fcc79d479-jtww9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-5c9018-openshift-default-6fbf4dcb9b-sdq5p

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1de9a7-87ff8d57c-m4f4b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1de9a7-5c795988b6-sskqk

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-1de9a7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1de9a7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-1de9a7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1de9a7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 569b4e12-bbd2-4e42-b1c9-10443100c19d, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-1de9a7-openshift-default-6d55d77bfd-5wtcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b1baac-5678c7d86f-ns8b9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b1baac-5497cdb49d-8bj2l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-b1baac-openshift-default-5485d669cd-h5zfb

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)