Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd to ip-10-0-143-186.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6 to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2 to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2 to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2 to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k to ip-10-0-143-38.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

Scheduled

Successfully assigned openshift-ingress/e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9 to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-45f425-685cfff579-szmt4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-45f425-685cfff579-szmt4 to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-dkm2p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-dkm2p to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47 to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-ait-963aea34-5df966b875-fxngj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-963aea34-5df966b875-fxngj to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-7hp29

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-7hp29 to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695 to ip-10-0-143-186.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-slfdj

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-slfdj to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28 to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8 to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb to ip-10-0-143-186.ec2.internal

openshift-ingress

kube-auth-proxy-8b786b9b5-wppgk

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8b786b9b5-wppgk to ip-10-0-140-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-g4xvk to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8 to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-4nssc

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4nssc to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-78572

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-78572 to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk to ip-10-0-143-38.ec2.internal

openshift-ingress

router-default-9998785cb-l2lkw

Scheduled

Successfully assigned openshift-ingress/router-default-9998785cb-l2lkw to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq to ip-10-0-143-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh to ip-10-0-143-38.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5 to ip-10-0-143-186.ec2.internal

openshift-ingress

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg to ip-10-0-143-38.ec2.internal

openshift-ingress

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq to ip-10-0-143-186.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-mjlb7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-mjlb7 to ip-10-0-143-38.ec2.internal

openshift-ingress

kube-auth-proxy-8b786b9b5-h9glx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8b786b9b5-h9glx to ip-10-0-143-186.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-9998785cb from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-9998785cb

FailedCreate

Error creating: pods "router-default-9998785cb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-9998785cb

FailedCreate

Error creating: pods "router-default-9998785cb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-9998785cb

SuccessfulCreate

Created pod: router-default-9998785cb-l2lkw
(x6)

openshift-ingress

kubelet

router-default-9998785cb-l2lkw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-9998785cb-l2lkw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-9998785cb-l2lkw

Started

Started container router

openshift-ingress

kubelet

router-default-9998785cb-l2lkw

Created

Created container: router

openshift-ingress

kubelet

router-default-9998785cb-l2lkw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

multus

router-default-9998785cb-l2lkw

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-8b786b9b5

FailedCreate

Error creating: pods "kube-auth-proxy-8b786b9b5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8b786b9b5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-8b786b9b5

SuccessfulCreate

Created pod: kube-auth-proxy-8b786b9b5-wppgk

openshift-ingress

replicaset-controller

kube-auth-proxy-8b786b9b5

SuccessfulCreate

Created pod: kube-auth-proxy-8b786b9b5-h9glx

openshift-ingress

multus

kube-auth-proxy-8b786b9b5-wppgk

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-wppgk

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8b786b9b5-h9glx

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-h9glx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-slfdj

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-slfdj

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-h9glx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.715s (2.715s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-h9glx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-h9glx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-slfdj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-wppgk

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-wppgk

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8b786b9b5-wppgk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.138s (3.138s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-slfdj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.417s (2.417s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-slfdj

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-slfdj

Started

Started container discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.662s (2.662s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-tnzgd

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.71s (2.71s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcrq4b6

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-mjlb7

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-mjlb7

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mjlb7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mjlb7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mjlb7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-mjlb7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.468s (2.468s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-slfdj

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-slfdj

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-g4xvk

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.438s (2.438s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-78572

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-4nssc

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4nssc

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-78572

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nssc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-78572

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nssc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.299s (2.299s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-78572

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.207s (2.207s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-78572

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-78572

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nssc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nssc

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-g4xvk

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-78572

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4nssc

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-7hp29

openshift-ingress

kubelet

payload-processing-85fd65c94c-7hp29

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-85fd65c94c-7hp29

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-dkm2p

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1

openshift-ingress

multus

payload-pre-processing-76f657cdc4-dkm2p

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-dkm2p

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-85fd65c94c-7hp29

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.069s (1.069s including waiting). Image size: 141049838 bytes.

openshift-ingress

kubelet

payload-processing-85fd65c94c-7hp29

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-7hp29

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-dkm2p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-dkm2p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-dkm2p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 2.079s (2.079s including waiting). Image size: 141049838 bytes.

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-cc1b19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-cc1b19

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f91f97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f91f97

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-580e01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-580e01

openshift-ingress

replicaset-controller

e2e-inf-a-f91f97-openshift-default-7dc8555bfd

SuccessfulCreate

Created pod: e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

openshift-ingress

multus

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-f91f97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f91f97-openshift-default-7dc8555bfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d

SuccessfulCreate

Created pod: e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

openshift-ingress

deployment-controller

e2e-worker-w0-cc1b19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w3-580e01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-580e01-openshift-default-db458d66d from 0 to 1

openshift-ingress

multus

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w3-580e01-openshift-default-db458d66d

SuccessfulCreate

Created pod: e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f91f97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f91f97-597bb7c965 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f91f97-597bb7c965

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f91f97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f91f97-597bb7c965

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f91f97-597bb7c965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f91f97: serviceaccount "payload-processing-e2e-inf-a-f91f97" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f91f97: serviceaccount "payload-processing-e2e-inf-a-f91f97" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-580e01-6885674c9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-580e01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-580e01-6885674c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-580e01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-580e01-84f778859d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-580e01-6885674c9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-580e01-6885674c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-580e01: serviceaccount "payload-processing-e2e-worker-w3-580e01" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-580e01-84f778859d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-580e01-84f778859d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-580e01-84f778859d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-580e01: serviceaccount "payload-processing-e2e-worker-w3-580e01" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-cc1b19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cc1b19: serviceaccount "payload-processing-e2e-worker-w0-cc1b19" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cc1b19-d96b479d9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-cc1b19-d96b479d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cc1b19: serviceaccount "payload-processing-e2e-worker-w0-cc1b19" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-cc1b19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-cc1b19-d96b479d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cc1b19-d96b479d9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-b21bfa16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b21bfa16

openshift-ingress

deployment-controller

e2e-ait-b21bfa16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b21bfa16-openshift-default-65d6c97bc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b21bfa16-openshift-default-65d6c97bc4

SuccessfulCreate

Created pod: e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

openshift-ingress

multus

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b21bfa16-5849646f46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b21bfa16-5849646f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b21bfa16: serviceaccount "payload-processing-e2e-ait-b21bfa16" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b21bfa16-7ddc596d8f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b21bfa16-5849646f46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b21bfa16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b21bfa16-7ddc596d8f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b21bfa16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b21bfa16-5849646f46 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b21bfa16-7ddc596d8f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b21bfa16-7ddc596d8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b21bfa16: serviceaccount "payload-processing-e2e-ait-b21bfa16" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

ProbeError

Readiness probe error: Get "http://10.132.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Unhealthy

Readiness probe failed: Get "http://10.132.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

deployment-controller

e2e-inf-b-6cf6a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-6cf6a0-openshift-default-6db59cf67b from 0 to 1

openshift-ingress

multus

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-6cf6a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-6cf6a0

openshift-ingress

replicaset-controller

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b

SuccessfulCreate

Created pod: e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-6cf6a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6cf6a0: serviceaccount "payload-processing-e2e-inf-b-6cf6a0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-6cf6a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-6cf6a0: serviceaccount "payload-processing-e2e-inf-b-6cf6a0" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-b21bfa16-7ddc596d8f-lzlrr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-b21bfa16

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-b21bfa16": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-b21bfa16, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9157a918-541f-4f88-b85f-eb69d600786e, UID in object meta:
(x5)

openshift-ingress

kubelet

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b21bfa16-openshift-default-65d6c97bc4-4kpkr

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b21bfa16-5849646f46-qfctz

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-fb988ee6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-fb988ee6-gw

openshift-ingress

deployment-controller

e2e-migrate-fb988ee6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d

SuccessfulCreate

Created pod: e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

openshift-ingress

multus

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-fb988ee6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-fb988ee6-dc9c5f958 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fb988ee6-dc9c5f958

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-fb988ee6-dc9c5f958

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-fb988ee6-dc9c5f958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fb988ee6: serviceaccount "payload-processing-e2e-migrate-fb988ee6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-fb988ee6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-fb988ee6: serviceaccount "payload-processing-e2e-migrate-fb988ee6" not found
(x2)

openshift-ingress

kubelet

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-fb988ee6-dc9c5f958-trqn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-fb988ee6-6fc9c645db-gj64t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ait-963aea34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-963aea34-openshift-default-6db4564b96 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-fb988ee6-gw-openshift-default-684f6b4d4d-rh6tw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ait-963aea34-openshift-default-6db4564b96

SuccessfulCreate

Created pod: e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

openshift-ingress

gateway_labeler_controller

e2e-ait-963aea34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-963aea34

openshift-ingress

multus

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-963aea34-578447dc94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-963aea34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-963aea34-578447dc94 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-963aea34-578447dc94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-963aea34-578447dc94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-963aea34: serviceaccount "payload-processing-e2e-ait-963aea34" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-963aea34-5df966b875

FailedCreate

Error creating: pods "payload-processing-e2e-ait-963aea34-5df966b875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-963aea34: serviceaccount "payload-processing-e2e-ait-963aea34" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-963aea34-5df966b875

SuccessfulCreate

Created pod: payload-processing-e2e-ait-963aea34-5df966b875-fxngj

openshift-ingress

deployment-controller

payload-processing-e2e-ait-963aea34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-963aea34-5df966b875 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-963aea34-5df966b875-fxngj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-963aea34-5df966b875-fxngj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-963aea34-5df966b875-fxngj

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-963aea34-5df966b875-fxngj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-963aea34

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-963aea34: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-963aea34": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-963aea34, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 600ae185-88f8-45fb-8608-6c6decd86e12, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-963aea34-578447dc94-q4bmw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-963aea34-5df966b875-fxngj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-963aea34-openshift-default-6db4564b96-nvfr9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-219b8581-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-219b8581-openshift-default-c556c6d48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-219b8581

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-219b8581

openshift-ingress

replicaset-controller

e2e-derive-219b8581-openshift-default-c556c6d48

SuccessfulCreate

Created pod: e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

openshift-ingress

multus

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-219b8581-579cffd574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-219b8581-7bb49b54f7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-219b8581-7bb49b54f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-219b8581: serviceaccount "payload-processing-e2e-derive-219b8581" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-219b8581-7bb49b54f7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

openshift-ingress

deployment-controller

payload-processing-e2e-derive-219b8581

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-219b8581-7bb49b54f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-219b8581

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-219b8581-579cffd574 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-219b8581-579cffd574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-219b8581-579cffd574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-219b8581: serviceaccount "payload-processing-e2e-derive-219b8581" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-derive-219b8581-7bb49b54f7-5hhzr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-219b8581-579cffd574-smg2k

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-derive-219b8581-openshift-default-c556c6d48-zpxhg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-c3f23ba4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c3f23ba4

openshift-ingress

multus

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-c3f23ba4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c3f23ba4-openshift-default-5cb4bcc884 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884

SuccessfulCreate

Created pod: e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c3f23ba4: serviceaccount "payload-processing-e2e-mt-c3f23ba4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c3f23ba4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c3f23ba4: serviceaccount "payload-processing-e2e-mt-c3f23ba4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c3f23ba4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

openshift-ingress

kubelet

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-c3f23ba4-6b6bccbc8f-6lzjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c3f23ba4-7cf6f57ff4-vndzb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f91f97-597bb7c965-7nr47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f91f97-7b55974cc4-2xnxb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-c3f23ba4-openshift-default-5cb4bcc884-rlv6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-f91f97-openshift-default-7dc8555bfd-j5pk8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-6cf6a0-68d7c46bc8-6gqnr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-6cf6a0-7c9ff4fcdc-4qfcr

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8

SuccessfulCreate

Created pod: e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

openshift-ingress

deployment-controller

e2e-shared-a-w1-9ac6b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-9ac6b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-9ac6b3

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3: serviceaccount "payload-processing-e2e-shared-a-w1-9ac6b3" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-9ac6b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-9ac6b3: serviceaccount "payload-processing-e2e-shared-a-w1-9ac6b3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-9ac6b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-6cf6a0-openshift-default-6db59cf67b-2scsr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-72e262

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-72e262

openshift-ingress

multus

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-72e262-openshift-default-697f564d74

SuccessfulCreate

Created pod: e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

openshift-ingress

deployment-controller

e2e-shared-a-w2-72e262-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-72e262-openshift-default-697f564d74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-72e262: serviceaccount "payload-processing-e2e-shared-a-w2-72e262" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-72e262

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-72e262-794875d7b5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-72e262-794875d7b5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-72e262-794875d7b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-72e262: serviceaccount "payload-processing-e2e-shared-a-w2-72e262" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-72e262-794875d7b5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-72e262

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-266c89-openshift-default-58d56d4678

SuccessfulCreate

Created pod: e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-266c89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-266c89
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w1-266c89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-266c89-openshift-default-58d56d4678 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-99b43e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-99b43e

openshift-ingress

deployment-controller

e2e-shared-b-w2-99b43e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b

SuccessfulCreate

Created pod: e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

openshift-ingress

multus

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-266c89-7b444bc549

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-266c89-7b444bc549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-266c89: serviceaccount "payload-processing-e2e-shared-b-w1-266c89" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-266c89: serviceaccount "payload-processing-e2e-shared-b-w1-266c89" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-266c89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-266c89-d99785978 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-266c89-7b444bc549

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-266c89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-266c89-7b444bc549 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-99b43e: serviceaccount "payload-processing-e2e-shared-b-w2-99b43e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-99b43e-76dccf875

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-99b43e-76dccf875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-99b43e: serviceaccount "payload-processing-e2e-shared-b-w2-99b43e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-99b43e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-99b43e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-99b43e-76dccf875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-99b43e-76dccf875

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-e6f44882-openshift-default-69467ff6b8

SuccessfulCreate

Created pod: e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

openshift-ingress

deployment-controller

e2e-mt-e6f44882-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e6f44882-openshift-default-69467ff6b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-e6f44882

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e6f44882

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e6f44882

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e6f44882: serviceaccount "payload-processing-e2e-mt-e6f44882" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e6f44882-b49b6749c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e6f44882

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e6f44882-b49b6749c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e6f44882-b49b6749c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e6f44882-b49b6749c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e6f44882: serviceaccount "payload-processing-e2e-mt-e6f44882" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-580e01-84f778859d-dqwdk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-580e01-6885674c9-cfrxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-580e01-openshift-default-db458d66d-xt2xt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-mt-e6f44882-b49b6749c-5c5nl

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-e6f44882

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-e6f44882: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-e6f44882": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-e6f44882, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 000242a4-efed-4ad3-9ed8-5914bcf11d71, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e6f44882-bb8bb6b5d-hjsxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc1b19-d96b479d9-xpzmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc1b19-7cd89f954b-46qxq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-cc1b19-openshift-default-5cc7cfc5d-xg6vb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-e6f44882-openshift-default-69467ff6b8-mjlqk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-45f425-openshift-default-bbcc9f4d4

SuccessfulCreate

Created pod: e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

openshift-ingress

deployment-controller

e2e-api-a-45f425-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-45f425-openshift-default-bbcc9f4d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-45f425

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-45f425

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-45f425

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-45f425-685cfff579 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-45f425-685cfff579-szmt4

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-45f425-d699cbf98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-45f425-d699cbf98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-45f425: serviceaccount "payload-processing-e2e-api-a-45f425" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-45f425

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-45f425-d699cbf98 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-45f425-685cfff579-szmt4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-45f425-685cfff579-szmt4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-45f425-685cfff579

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-45f425-685cfff579-szmt4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-45f425-d699cbf98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-45f425-685cfff579

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-45f425-685cfff579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-45f425: serviceaccount "payload-processing-e2e-api-a-45f425" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-45f425-685cfff579-szmt4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-a1c584-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a1c584-openshift-default-847dcdd99d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-a1c584-openshift-default-847dcdd99d

SuccessfulCreate

Created pod: e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

openshift-ingress

gateway_labeler_controller

e2e-api-b-a1c584

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a1c584

openshift-ingress

multus

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a1c584: serviceaccount "payload-processing-e2e-api-b-a1c584" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a1c584

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a1c584-7f67577f49 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a1c584

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a1c584-7f67577f49

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a1c584-7f67577f49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a1c584: serviceaccount "payload-processing-e2e-api-b-a1c584" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a1c584-7f67577f49

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

openshift-ingress

kubelet

payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp
(x2)

openshift-ingress

kubelet

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-45f425-d699cbf98-lrjvx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-45f425-685cfff579-szmt4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-45f425-openshift-default-bbcc9f4d4-6nsnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a1c584-5bf4995bc4-vprbp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a1c584-7f67577f49-82qd5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-a1c584-openshift-default-847dcdd99d-2nzxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-9ac6b3-64bdb7b8dc-n8mwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-9ac6b3-6f689fbdc8-nd695

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-9ac6b3-openshift-default-7f864ccbd8-g2j5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-266c89-7b444bc549-x5xmk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-266c89-d99785978-zz7tl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-266c89-openshift-default-58d56d4678-wc78j

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-bd3aad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-bd3aad

openshift-ingress

replicaset-controller

e2e-ipp-a-bd3aad-openshift-default-66977bc66d

SuccessfulCreate

Created pod: e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

openshift-ingress

deployment-controller

e2e-ipp-a-bd3aad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-bd3aad-openshift-default-66977bc66d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-bd3aad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-bd3aad-5c658ccc9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-bd3aad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bd3aad: serviceaccount "payload-processing-e2e-ipp-a-bd3aad" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-bd3aad: serviceaccount "payload-processing-e2e-ipp-a-bd3aad" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": read tcp 10.133.0.2:37844->10.133.0.77:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": read tcp 10.133.0.2:37844->10.133.0.77:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-f210d9-openshift-default-698757f6bd

SuccessfulCreate

Created pod: e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

openshift-ingress

deployment-controller

e2e-ipp-b-f210d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f210d9-openshift-default-698757f6bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f210d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f210d9

openshift-ingress

multus

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f210d9-7df74697b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f210d9: serviceaccount "payload-processing-e2e-ipp-b-f210d9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f210d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f210d9-7df74697b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f210d9-7df74697b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f210d9: serviceaccount "payload-processing-e2e-ipp-b-f210d9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f210d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f210d9-7df74697b7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-953b43

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-953b43

openshift-ingress

deployment-controller

e2e-ipp-cleanup-953b43-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-953b43-openshift-default-68f67744cb from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-953b43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43: serviceaccount "payload-processing-e2e-ipp-cleanup-953b43" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-953b43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-953b43: serviceaccount "payload-processing-e2e-ipp-cleanup-953b43" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-953b43-865b99dc8c-4lcb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-953b43-6458fdff9d-b9sfj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-953b43-openshift-default-68f67744cb-48m8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-bd3aad-566fd59dc4-bcpb2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-bd3aad-5c658ccc9-h5wpg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-bd3aad-openshift-default-66977bc66d-g9qzx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-f210d9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-f210d9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-f210d9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-f210d9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0f4e67cf-3ca7-4a8b-8033-a8757e0bcd94, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f210d9-7df74697b7-8m67j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f210d9-6fdd6c549d-wlprn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-f210d9-openshift-default-698757f6bd-lp2sq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-72e262-794875d7b5-nqmtb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-72e262-75b57bb594-5nl28

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-72e262-openshift-default-697f564d74-rzjqt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99b43e-76dccf875-6bqqh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99b43e-5dd5c4559d-nzmpb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-99b43e-openshift-default-85c9b5cc9b-8ztq8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503