Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5 to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-62vnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-62vnh to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982 to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn to ip-10-0-137-163.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-k8rzw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8 to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65 to ip-10-0-137-163.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-8v4sx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-354c80-bfd69945c-l2phv to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-2748c5-f65968655-trwmp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2748c5-f65968655-trwmp to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-autores-765a18-8576855845-4qwxt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-765a18-8576855845-4qwxt to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9 to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl to ip-10-0-137-163.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e85410da-openshift-default-545cf9b67b-pls99 to ip-10-0-142-224.ec2.internal

openshift-ingress

kube-auth-proxy-677bd9b6b8-b9ttr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k to ip-10-0-137-163.ec2.internal

openshift-ingress

kube-auth-proxy-677bd9b6b8-p99rw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-677bd9b6b8-p99rw to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs to ip-10-0-142-224.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55 to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5 to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7 to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6 to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8 to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5 to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx to ip-10-0-142-224.ec2.internal

openshift-ingress

router-default-7d9d59f4d8-jpdvl

Scheduled

Successfully assigned openshift-ingress/router-default-7d9d59f4d8-jpdvl to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56 to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-57cp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-57cp9 to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj to ip-10-0-142-224.ec2.internal

openshift-ingress

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

Scheduled

Successfully assigned openshift-ingress/e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8 to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh to ip-10-0-137-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4 to ip-10-0-137-163.ec2.internal

openshift-ingress

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6 to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb to ip-10-0-142-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn to ip-10-0-142-224.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7d9d59f4d8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-7d9d59f4d8

FailedCreate

Error creating: pods "router-default-7d9d59f4d8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7d9d59f4d8

FailedCreate

Error creating: pods "router-default-7d9d59f4d8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7d9d59f4d8

SuccessfulCreate

Created pod: router-default-7d9d59f4d8-jpdvl
(x6)

openshift-ingress

kubelet

router-default-7d9d59f4d8-jpdvl

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7d9d59f4d8-jpdvl

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-7d9d59f4d8-jpdvl

Started

Started container router

openshift-ingress

kubelet

router-default-7d9d59f4d8-jpdvl

Created

Created container: router

openshift-ingress

kubelet

router-default-7d9d59f4d8-jpdvl

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-7d9d59f4d8-jpdvl

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-677bd9b6b8 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-677bd9b6b8

SuccessfulCreate

Created pod: kube-auth-proxy-677bd9b6b8-p99rw

openshift-ingress

replicaset-controller

kube-auth-proxy-677bd9b6b8

SuccessfulCreate

Created pod: kube-auth-proxy-677bd9b6b8-b9ttr
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-677bd9b6b8

FailedCreate

Error creating: pods "kube-auth-proxy-677bd9b6b8-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-677bd9b6b8-p99rw

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-b9ttr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-p99rw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-677bd9b6b8-b9ttr

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-8v4sx

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-p99rw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.689s (2.689s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-p99rw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-8v4sx

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-b9ttr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-b9ttr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-p99rw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-677bd9b6b8-b9ttr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.889s (2.889s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.359s (2.359s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.824s (2.824s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7q8fg

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-k8rzw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k8rzw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k8rzw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-k8rzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-k8rzw

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-8v4sx

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-8v4sx

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-2rp55

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-2rp55

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.948s (2.948s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-62vnh

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-57cp9

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-62vnh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-57cp9

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-62vnh

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-57cp9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-57cp9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-57cp9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.293s (1.293s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-57cp9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-62vnh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.25s (1.25s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-62vnh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-62vnh

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2rp55

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-26462a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-26462a

openshift-ingress

deployment-controller

e2e-worker-w0-ea5e33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-26462a-openshift-default-559c6996b4

SuccessfulCreate

Created pod: e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

openshift-ingress

deployment-controller

e2e-worker-w4-962a7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-962a7d-openshift-default-857cb8c4db from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-962a7d-openshift-default-857cb8c4db

SuccessfulCreate

Created pod: e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

openshift-ingress

deployment-controller

e2e-inf-a-26462a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-26462a-openshift-default-559c6996b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4

SuccessfulCreate

Created pod: e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-ea5e33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-ea5e33

openshift-ingress

multus

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-962a7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-962a7d

openshift-ingress

multus

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-962a7d-5667fd497c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-962a7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-962a7d-5667fd497c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-962a7d-5667fd497c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-962a7d: serviceaccount "payload-processing-e2e-worker-w4-962a7d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-962a7d: serviceaccount "payload-processing-e2e-worker-w4-962a7d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-962a7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-962a7d-5667fd497c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-26462a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-26462a-854bf7ff54 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-26462a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-26462a-75c6958dff from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-26462a-75c6958dff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-26462a-75c6958dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-26462a: serviceaccount "payload-processing-e2e-inf-a-26462a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-ea5e33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-ea5e33-7ff4d49959 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-26462a: serviceaccount "payload-processing-e2e-inf-a-26462a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.324s (1.324s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-26462a-75c6958dff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-ea5e33: serviceaccount "payload-processing-e2e-worker-w0-ea5e33" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-ea5e33: serviceaccount "payload-processing-e2e-worker-w0-ea5e33" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-ea5e33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-765a18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-765a18

openshift-ingress

gateway_labeler_controller

e2e-ait-8dbad4ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8dbad4ec

openshift-ingress

replicaset-controller

e2e-autores-765a18-openshift-default-6d9688fc58

SuccessfulCreate

Created pod: e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

openshift-ingress

deployment-controller

e2e-autores-765a18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-765a18-openshift-default-6d9688fc58 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-8dbad4ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8dbad4ec-openshift-default-68c79d4446 from 0 to 1

openshift-ingress

multus

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-8dbad4ec-openshift-default-68c79d4446

SuccessfulCreate

Created pod: e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.519s (2.519s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.473s (2.473s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.824s (2.824s including waiting). Image size: 181318953 bytes.
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-765a18-676c6c664b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-765a18-676c6c664b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-765a18: serviceaccount "payload-processing-e2e-autores-765a18" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-765a18-676c6c664b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-765a18-8576855845

FailedCreate

Error creating: pods "payload-processing-e2e-autores-765a18-8576855845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-765a18: serviceaccount "payload-processing-e2e-autores-765a18" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-765a18-8576855845

SuccessfulCreate

Created pod: payload-processing-e2e-autores-765a18-8576855845-4qwxt

openshift-ingress

deployment-controller

payload-processing-e2e-autores-765a18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-765a18-8576855845 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-765a18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-765a18-676c6c664b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-2b95f8-openshift-default-747894dc76

SuccessfulCreate

Created pod: e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

openshift-ingress

kubelet

payload-processing-e2e-autores-765a18-8576855845-4qwxt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-765a18-8576855845-4qwxt

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-765a18-8576855845-4qwxt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-765a18-8576855845-4qwxt

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-2b95f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-2b95f8

openshift-ingress

deployment-controller

e2e-inf-b-2b95f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-2b95f8-openshift-default-747894dc76 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8dbad4ec: serviceaccount "payload-processing-e2e-ait-8dbad4ec" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8dbad4ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8dbad4ec-58b76df45c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8dbad4ec-58b76df45c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8dbad4ec: serviceaccount "payload-processing-e2e-ait-8dbad4ec" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8dbad4ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8dbad4ec-58b76df45c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8dbad4ec-58b76df45c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

openshift-ingress

kubelet

payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-2b95f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-2b95f8-67577b6c95 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2b95f8: serviceaccount "payload-processing-e2e-inf-b-2b95f8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-2b95f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-2b95f8-8d7467674 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2b95f8-67577b6c95

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-2b95f8-67577b6c95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2b95f8: serviceaccount "payload-processing-e2e-inf-b-2b95f8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2b95f8-67577b6c95

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp
(x7)

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": read tcp 10.134.0.2:48584->10.134.0.47:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": read tcp 10.134.0.2:48584->10.134.0.47:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-8dbad4ec-58b76df45c-9tvw8

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8dbad4ec-5f6b69699d-fkk6m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4

SuccessfulCreate

Created pod: e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

openshift-ingress

deployment-controller

e2e-migrate-2d3d3219-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-2d3d3219-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2d3d3219-gw

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-8dbad4ec-openshift-default-68c79d4446-tbdlm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2d3d3219-5557684d66

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2d3d3219-5557684d66

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2d3d3219-5557684d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2d3d3219: serviceaccount "payload-processing-e2e-migrate-2d3d3219" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2d3d3219: serviceaccount "payload-processing-e2e-migrate-2d3d3219" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2d3d3219

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2d3d3219-664b44b54 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2d3d3219

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2d3d3219-5557684d66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2d3d3219-664b44b54-m6hln

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2d3d3219-5557684d66-q92bs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-2d3d3219-gw-openshift-default-dockercfg-ggmql); attempting to pull the image may not succeed.

openshift-ingress

gateway_labeler_controller

e2e-ait-257d9182

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-257d9182

openshift-ingress

deployment-controller

e2e-ait-257d9182-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-257d9182-openshift-default-78fd69dc76 from 0 to 1

openshift-ingress

multus

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-257d9182-openshift-default-78fd69dc76

SuccessfulCreate

Created pod: e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

openshift-ingress

kubelet

e2e-migrate-2d3d3219-gw-openshift-default-5bff794cd4-5lp6z

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-257d9182-6fff4bbc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-257d9182-6fff4bbc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-257d9182: serviceaccount "payload-processing-e2e-ait-257d9182" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-257d9182-7b8498cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-257d9182-7b8498cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-257d9182: serviceaccount "payload-processing-e2e-ait-257d9182" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-257d9182-7b8498cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-257d9182

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-257d9182-7b8498cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-257d9182-6fff4bbc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

openshift-ingress

deployment-controller

payload-processing-e2e-ait-257d9182

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-257d9182-6fff4bbc5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-257d9182-6fff4bbc5-xp2xw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-257d9182-7b8498cd-tqrqj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-257d9182

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-257d9182: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-257d9182": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-257d9182, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5b4933a1-51bf-4c22-8345-ea4295685330, UID in object meta:

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-5fdb611f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-5fdb611f-openshift-default-554c776b48 from 0 to 1

openshift-ingress

multus

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-5fdb611f-openshift-default-554c776b48

SuccessfulCreate

Created pod: e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

openshift-ingress

gateway_labeler_controller

e2e-derive-5fdb611f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-5fdb611f
(x2)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-257d9182-openshift-default-78fd69dc76-ghhlh

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-derive-5fdb611f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-5fdb611f-569b6dffc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-5fdb611f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5fdb611f: serviceaccount "payload-processing-e2e-derive-5fdb611f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5fdb611f-569b6dffc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-5fdb611f-569b6dffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5fdb611f: serviceaccount "payload-processing-e2e-derive-5fdb611f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5fdb611f-569b6dffc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-5fdb611f-569b6dffc-9scrl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5fdb611f-6f6c9d986-n4khh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-5fdb611f-openshift-default-554c776b48-7cdz6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-765a18-676c6c664b-7pxdk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-765a18-8576855845-4qwxt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ea5e33-7ff4d49959-jfcpx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ea5e33-5f8584d474-hppxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-962a7d-54fcd4b8db-h7sk5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-962a7d-openshift-default-857cb8c4db-8f5zn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-ea5e33-openshift-default-6c999c7fd4-hvnzc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-explicit-7ae28e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7ae28e-openshift-default-8958845b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-7ae28e-openshift-default-8958845b4

SuccessfulCreate

Created pod: e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

openshift-ingress

gateway_labeler_controller

e2e-explicit-7ae28e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7ae28e

openshift-ingress

kubelet

e2e-autores-765a18-openshift-default-6d9688fc58-8w2v8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7ae28e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7ae28e-ccbcc88f7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7ae28e-ccbcc88f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7ae28e: serviceaccount "payload-processing-e2e-explicit-7ae28e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7ae28e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7ae28e-ccbcc88f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7ae28e: serviceaccount "payload-processing-e2e-explicit-7ae28e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7ae28e-ccbcc88f7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-mt-e85410da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e85410da-openshift-default-545cf9b67b from 0 to 1

openshift-ingress

multus

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-e85410da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e85410da

openshift-ingress

replicaset-controller

e2e-mt-e85410da-openshift-default-545cf9b67b

SuccessfulCreate

Created pod: e2e-mt-e85410da-openshift-default-545cf9b67b-pls99
(x2)

openshift-ingress

kubelet

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e85410da-dcf5cb458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e85410da-dcf5cb458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e85410da-dcf5cb458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e85410da: serviceaccount "payload-processing-e2e-mt-e85410da" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e85410da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e85410da-dcf5cb458 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e85410da-7dd8ffb945

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e85410da-7dd8ffb945-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e85410da: serviceaccount "payload-processing-e2e-mt-e85410da" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e85410da-7dd8ffb945

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e85410da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e85410da-7dd8ffb945 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-e85410da-7dd8ffb945-z89fg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e85410da-dcf5cb458-k44sh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-e85410da-openshift-default-545cf9b67b-pls99

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-7ae28e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-7ae28e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-7ae28e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9d4eec1a-cc6d-47a2-9fcb-ea1303adb931, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-7ae28e-ccbcc88f7-pkjzt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7ae28e-6c7b9cd94-m2psz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-7ae28e-openshift-default-8958845b4-4xnsb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-ae7b6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ae7b6a

openshift-ingress

deployment-controller

e2e-noten-ae7b6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ae7b6a-openshift-default-5c577d7496 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-ae7b6a-openshift-default-5c577d7496

SuccessfulCreate

Created pod: e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

openshift-ingress

kubelet

e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86

SuccessfulCreate

Created pod: e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

openshift-ingress

deployment-controller

e2e-shared-a-w2-1117b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-1117b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-1117b2

openshift-ingress

multus

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1117b2: serviceaccount "payload-processing-e2e-shared-a-w2-1117b2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-1117b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-1117b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1117b2: serviceaccount "payload-processing-e2e-shared-a-w2-1117b2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-55fb09-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78

SuccessfulCreate

Created pod: e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

openshift-ingress

multus

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-55fb09

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-55fb09

openshift-ingress

kubelet

e2e-noten-ae7b6a-openshift-default-5c577d7496-9gjcd

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-55fb09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-55fb09-74998c669

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-55fb09-74998c669

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-55fb09-74998c669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09: serviceaccount "payload-processing-e2e-shared-b-w2-55fb09" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-55fb09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-55fb09-74998c669 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-55fb09: serviceaccount "payload-processing-e2e-shared-b-w2-55fb09" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-26462a-854bf7ff54-2zldl

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-26462a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-26462a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-26462a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-26462a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bbc62c6a-1bf7-4de8-847d-b50ee2361056, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-26462a-75c6958dff-gnp6v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-26462a-openshift-default-559c6996b4-wtnfw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-908a1435-openshift-default-7d54d9b748

SuccessfulCreate

Created pod: e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

openshift-ingress

deployment-controller

e2e-mt-908a1435-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-908a1435-openshift-default-7d54d9b748 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-908a1435

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-908a1435

openshift-ingress

multus

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-908a1435-76bdf8d7b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-908a1435

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-908a1435-67f77f65f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-908a1435-76bdf8d7b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-908a1435-76bdf8d7b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-908a1435: serviceaccount "payload-processing-e2e-mt-908a1435" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-908a1435

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-908a1435-76bdf8d7b5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-908a1435-67f77f65f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-908a1435-67f77f65f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-908a1435: serviceaccount "payload-processing-e2e-mt-908a1435" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-908a1435-67f77f65f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2b95f8-67577b6c95-7b7hp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2b95f8-8d7467674-ms982

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2bd772

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2bd772

openshift-ingress

deployment-controller

e2e-shared-a-w3-2bd772-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2bd772-openshift-default-57c966f864 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2bd772-openshift-default-57c966f864

SuccessfulCreate

Created pod: e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-2b95f8-openshift-default-747894dc76-fjkrh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2bd772

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2bd772: serviceaccount "payload-processing-e2e-shared-a-w3-2bd772" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2bd772: serviceaccount "payload-processing-e2e-shared-a-w3-2bd772" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2bd772

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-713791

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-713791

openshift-ingress

deployment-controller

e2e-shared-b-w3-713791-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-713791-openshift-default-6d9b794d66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-713791-openshift-default-6d9b794d66

SuccessfulCreate

Created pod: e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

openshift-ingress

multus

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-713791

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-713791-fc47fc45 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-713791-fc47fc45

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-713791-fc47fc45

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-713791-fc47fc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-713791: serviceaccount "payload-processing-e2e-shared-b-w3-713791" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-713791: serviceaccount "payload-processing-e2e-shared-b-w3-713791" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-713791

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-908a1435-76bdf8d7b5-lq7k6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-908a1435-67f77f65f8-dqkhj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-908a1435-openshift-default-7d54d9b748-6mx5k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-354c80-openshift-default-5d49bc8ff8

SuccessfulCreate

Created pod: e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

openshift-ingress

gateway_labeler_controller

e2e-api-a-354c80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-354c80

openshift-ingress

deployment-controller

e2e-api-a-354c80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-354c80-openshift-default-5d49bc8ff8 from 0 to 1

openshift-ingress

multus

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-354c80-bfd69945c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-354c80-bfd69945c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-354c80: serviceaccount "payload-processing-e2e-api-a-354c80" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-354c80-bfd69945c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-354c80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-354c80-b556f688b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-354c80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-354c80-bfd69945c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-354c80-b556f688b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-354c80-b556f688b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-354c80-b556f688b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-354c80: serviceaccount "payload-processing-e2e-api-a-354c80" not found

openshift-ingress

multus

payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-2748c5-openshift-default-9bf5d68d4

SuccessfulCreate

Created pod: e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

openshift-ingress

gateway_labeler_controller

e2e-api-b-2748c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2748c5

openshift-ingress

deployment-controller

e2e-api-b-2748c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2748c5-openshift-default-9bf5d68d4 from 0 to 1

openshift-ingress

multus

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2748c5-8445f79c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2748c5-f65968655

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2748c5-f65968655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2748c5: serviceaccount "payload-processing-e2e-api-b-2748c5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2748c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2748c5-f65968655 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2748c5-8445f79c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2748c5-8445f79c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2748c5: serviceaccount "payload-processing-e2e-api-b-2748c5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2748c5-f65968655

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2748c5-f65968655-trwmp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2748c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2748c5-8445f79c66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-2748c5-f65968655-trwmp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2748c5-f65968655-trwmp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2748c5-f65968655-trwmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-2748c5-f65968655-trwmp

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-354c80-bfd69945c-l2phv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-354c80-b556f688b-mfbw4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-354c80-openshift-default-5d49bc8ff8-g2qvl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2748c5-8445f79c66-z7zqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2748c5-f65968655-trwmp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-2748c5-openshift-default-9bf5d68d4-trdj8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1117b2-5bbf88f677-svsp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1117b2-754687b5f4-k9mxw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-1117b2-openshift-default-6d6cbccb86-sv7v9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55fb09-74998c669-5g8x5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55fb09-66bcf94998-8q22f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-55fb09-openshift-default-7c5d8cf78-q8zmh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-19ce3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-19ce3e-openshift-default-55f99d586 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-19ce3e-openshift-default-55f99d586

SuccessfulCreate

Created pod: e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-19ce3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-19ce3e

openshift-ingress

multus

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-19ce3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ce3e: serviceaccount "payload-processing-e2e-ipp-a-19ce3e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-19ce3e: serviceaccount "payload-processing-e2e-ipp-a-19ce3e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-19ce3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-e9c558-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-e9c558-openshift-default-5548bf6f78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-e9c558-openshift-default-5548bf6f78

SuccessfulCreate

Created pod: e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-e9c558

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-e9c558

openshift-ingress

multus

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e9c558-c84df4dfc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-e9c558-c84df4dfc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-e9c558-c84df4dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e9c558: serviceaccount "payload-processing-e2e-ipp-b-e9c558" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-e9c558

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-e9c558-c84df4dfc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e9c558-697749df78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-e9c558

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-e9c558-697749df78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-e9c558-697749df78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-e9c558-697749df78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-e9c558: serviceaccount "payload-processing-e2e-ipp-b-e9c558" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8a57ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8a57ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8a57ce

openshift-ingress

multus

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8a57ce: serviceaccount "payload-processing-e2e-ipp-cleanup-8a57ce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8a57ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8a57ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8a57ce: serviceaccount "payload-processing-e2e-ipp-cleanup-8a57ce" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8a57ce-5ccc6c59d5-5cvtj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8a57ce-689594dfd-l8z9q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8a57ce-openshift-default-d5698785d-csbwz

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-19ce3e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-19ce3e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-19ce3e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 229e7e41-0909-48fe-90f9-ff0c82948510, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-19ce3e-f6fdfdd94-lfbnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-19ce3e-585cfdb4d9-s7zlj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-19ce3e-openshift-default-55f99d586-9zn56

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-e9c558-697749df78-z4t65

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-e9c558-c84df4dfc-g4nkr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-e9c558-openshift-default-5548bf6f78-9mqd7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2bd772-7fc67c976c-nkbsd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2bd772-7ccf4bfdf8-fmsbb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-2bd772-openshift-default-57c966f864-sjzvd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-713791

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-713791: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-713791": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-713791, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bd1aad15-0eb4-4e6d-966b-5838957bc0f4, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-713791-fc47fc45-vlb4h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-713791-7b97b87c4-6mmrb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-713791-openshift-default-6d9b794d66-6248m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: