Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84 to ip-10-0-136-64.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vvd79

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vvd79 to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6 to ip-10-0-129-128.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6 to ip-10-0-135-209.ec2.internal

openshift-ingress

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-derive-94929d65-7585756849-6qvfk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-94929d65-7585756849-6qvfk to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e6108f-977b55475-7hjwj to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7 to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9 to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl to ip-10-0-136-64.ec2.internal

openshift-ingress

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-tp5mm

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-tp5mm to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5 to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4 to ip-10-0-135-209.ec2.internal

openshift-ingress

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7 to ip-10-0-135-209.ec2.internal

openshift-ingress

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795 to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424 to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv to ip-10-0-136-64.ec2.internal

openshift-ingress

kube-auth-proxy-9fbf455f6-ssznq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9fbf455f6-ssznq to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-ttfd5

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-ttfd5 to ip-10-0-135-209.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-cnvjt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-cnvjt to ip-10-0-135-209.ec2.internal

openshift-ingress

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

Scheduled

Successfully assigned openshift-ingress/e2e-mt-026961cf-openshift-default-845f5469cb-d5968 to ip-10-0-136-64.ec2.internal

openshift-ingress

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml to ip-10-0-135-209.ec2.internal

openshift-ingress

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l to ip-10-0-136-64.ec2.internal

openshift-ingress

router-default-598c64547d-8cwhs

Scheduled

Successfully assigned openshift-ingress/router-default-598c64547d-8cwhs to ip-10-0-135-209.ec2.internal

openshift-ingress

router-default-598c64547d-8cwhs

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4 to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79 to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7 to ip-10-0-136-64.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tvsjk to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc to ip-10-0-136-64.ec2.internal

openshift-ingress

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

Scheduled

Successfully assigned openshift-ingress/e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-59w9r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-59w9r to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk to ip-10-0-129-128.ec2.internal

openshift-ingress

kube-auth-proxy-9fbf455f6-rs4vh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-9fbf455f6-rs4vh to ip-10-0-135-209.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq to ip-10-0-136-64.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-gsz8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-gsz8b to ip-10-0-135-209.ec2.internal

openshift-ingress

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62 to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm to ip-10-0-129-128.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-598c64547d from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-598c64547d

FailedCreate

Error creating: pods "router-default-598c64547d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-598c64547d

FailedCreate

Error creating: pods "router-default-598c64547d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-598c64547d

SuccessfulCreate

Created pod: router-default-598c64547d-8cwhs
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-598c64547d-8cwhs

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-598c64547d-8cwhs

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-598c64547d-8cwhs

Started

Started container router

openshift-ingress

multus

router-default-598c64547d-8cwhs

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-598c64547d-8cwhs

Created

Created container: router

openshift-ingress

kubelet

router-default-598c64547d-8cwhs

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-9fbf455f6

FailedCreate

Error creating: pods "kube-auth-proxy-9fbf455f6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-9fbf455f6 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-9fbf455f6

SuccessfulCreate

Created pod: kube-auth-proxy-9fbf455f6-ssznq

openshift-ingress

replicaset-controller

kube-auth-proxy-9fbf455f6

SuccessfulCreate

Created pod: kube-auth-proxy-9fbf455f6-rs4vh

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-ssznq

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-rs4vh

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-9fbf455f6-rs4vh

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-ssznq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-rs4vh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-9fbf455f6-ssznq

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vvd79

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vvd79

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-ssznq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-rs4vh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-rs4vh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-rs4vh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.203s (3.203s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-ssznq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-9fbf455f6-ssznq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.995s (2.995s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.516s (2.516s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.985s (2.985s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8z7w6

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-cnvjt

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cnvjt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-cnvjt

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cnvjt

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cnvjt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.442s (2.442s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cnvjt

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cnvjt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cnvjt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vvd79

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vvd79

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-tvsjk

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-gsz8b

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-tp5mm
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tp5mm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-tp5mm

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gsz8b

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-gsz8b

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tp5mm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gsz8b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gsz8b

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.589s (1.589s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tp5mm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tp5mm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.594s (1.594s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gsz8b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-tvsjk

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gsz8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-tp5mm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

FailedCreate

Error creating: pods "payload-processing-85fd65c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-ttfd5

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-59w9r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

FailedCreate

Error creating: pods "payload-pre-processing-76f657cdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-76f657cdc4-59w9r

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-59w9r

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-85fd65c94c-ttfd5

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-85fd65c94c-ttfd5

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-59w9r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-59w9r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.363s (1.363s including waiting). Image size: 141049839 bytes.

openshift-ingress

kubelet

payload-processing-85fd65c94c-ttfd5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-ttfd5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-ttfd5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.326s (1.326s including waiting). Image size: 141049839 bytes.

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-59w9r

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-a-de7535

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-de7535

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-37c153

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-37c153

openshift-ingress

replicaset-controller

e2e-worker-w3-039dbc-openshift-default-78c6c5b876

SuccessfulCreate

Created pod: e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-039dbc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-039dbc

openshift-ingress

deployment-controller

e2e-worker-w3-039dbc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-039dbc-openshift-default-78c6c5b876 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-37c153-openshift-default-67c588ff5b

SuccessfulCreate

Created pod: e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

openshift-ingress

deployment-controller

e2e-worker-w0-37c153-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-37c153-openshift-default-67c588ff5b from 0 to 1

openshift-ingress

multus

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-de7535-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-de7535-openshift-default-69b96cc448 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-de7535-openshift-default-69b96cc448

SuccessfulCreate

Created pod: e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.857s (2.857s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.938s (2.938s including waiting). Image size: 181318953 bytes.
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-37c153-59b57ff795

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-37c153-59b57ff795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-37c153: serviceaccount "payload-processing-e2e-worker-w0-37c153" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-37c153

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-37c153-559788cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-37c153-559788cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-37c153

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-37c153-59b57ff795 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-37c153-559788cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-37c153-559788cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-37c153: serviceaccount "payload-processing-e2e-worker-w0-37c153" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-37c153-59b57ff795

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-039dbc-c8b479995

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-039dbc-c8b479995

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-039dbc-c8b479995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-039dbc: serviceaccount "payload-processing-e2e-worker-w3-039dbc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-039dbc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-039dbc: serviceaccount "payload-processing-e2e-worker-w3-039dbc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-039dbc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-039dbc-c8b479995 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-de7535-6dcf799cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-de7535-6dcf799cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-de7535: serviceaccount "payload-processing-e2e-inf-a-de7535" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-de7535-c9768d786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-de7535-c9768d786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-de7535: serviceaccount "payload-processing-e2e-inf-a-de7535" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-de7535-c9768d786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-de7535

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-de7535-c9768d786 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-de7535

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-de7535-6dcf799cf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-7fbf2b1b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7fbf2b1b

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-de7535-6dcf799cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.391s (1.391s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.365s (1.365s including waiting). Image size: 166449312 bytes.

openshift-ingress

deployment-controller

e2e-ait-7fbf2b1b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7fbf2b1b-openshift-default-5579d78456 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-7fbf2b1b-openshift-default-5579d78456

SuccessfulCreate

Created pod: e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

openshift-ingress

kubelet

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 315ms (315ms including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7fbf2b1b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7fbf2b1b-58fb765575 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7fbf2b1b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7fbf2b1b-657d97866 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7fbf2b1b-58fb765575

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7fbf2b1b-58fb765575

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7fbf2b1b-58fb765575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7fbf2b1b: serviceaccount "payload-processing-e2e-ait-7fbf2b1b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x2)

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7fbf2b1b: serviceaccount "payload-processing-e2e-ait-7fbf2b1b" not found

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

ProbeError

Readiness probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bcf02f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bcf02f
(x2)

openshift-ingress

kubelet

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

Started

Started container istio-proxy

openshift-ingress

multus

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-bcf02f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bcf02f-openshift-default-67c665cd9d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-bcf02f-openshift-default-67c665cd9d

SuccessfulCreate

Created pod: e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.096s (3.096s including waiting). Image size: 166449312 bytes.
(x5)

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bcf02f: serviceaccount "payload-processing-e2e-inf-b-bcf02f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bcf02f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bcf02f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bcf02f-67b6566689 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bcf02f-67b6566689

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bcf02f-67b6566689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bcf02f: serviceaccount "payload-processing-e2e-inf-b-bcf02f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bcf02f-67b6566689

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-7fbf2b1b-58fb765575-z5vm4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7fbf2b1b-657d97866-kz2rc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d

SuccessfulCreate

Created pod: e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

openshift-ingress

gateway_labeler_controller

e2e-migrate-2e816045-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2e816045-gw

openshift-ingress

deployment-controller

e2e-migrate-2e816045-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2e816045-gw-openshift-default-7c46c9448d from 0 to 1

openshift-ingress

multus

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-7fbf2b1b-openshift-default-5579d78456-hdtbl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2e816045

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2e816045-7b787dd846 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2e816045-7b787dd846

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2e816045-7b787dd846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2e816045: serviceaccount "payload-processing-e2e-migrate-2e816045" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2e816045-778864db74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2e816045-778864db74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2e816045: serviceaccount "payload-processing-e2e-migrate-2e816045" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2e816045-778864db74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

openshift-ingress

multus

payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2e816045

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2e816045-778864db74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2e816045-7b787dd846

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2e816045-778864db74-lnxc7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2e816045-7b787dd846-twqwr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-2e816045-gw-openshift-default-7c46c9448d-hbq8l

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-89dea9e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-89dea9e1

openshift-ingress

replicaset-controller

e2e-ait-89dea9e1-openshift-default-bc5c49556

SuccessfulCreate

Created pod: e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

openshift-ingress

multus

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-89dea9e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-89dea9e1-openshift-default-bc5c49556 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-89dea9e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-89dea9e1-7969c8dc9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-89dea9e1-7969c8dc9f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-89dea9e1-7969c8dc9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-89dea9e1: serviceaccount "payload-processing-e2e-ait-89dea9e1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-89dea9e1-557b58f446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

openshift-ingress

kubelet

payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-89dea9e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-89dea9e1-557b58f446 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-89dea9e1-557b58f446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-89dea9e1-557b58f446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-89dea9e1: serviceaccount "payload-processing-e2e-ait-89dea9e1" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-89dea9e1-7969c8dc9f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc
(x2)

openshift-ingress

kubelet

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-89dea9e1-557b58f446-9ct84

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-89dea9e1-7969c8dc9f-vjxmc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-89dea9e1-openshift-default-bc5c49556-tbhjg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-94929d65-openshift-default-74b74dcd4

SuccessfulCreate

Created pod: e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

openshift-ingress

gateway_labeler_controller

e2e-derive-94929d65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-94929d65

openshift-ingress

deployment-controller

e2e-derive-94929d65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-94929d65-openshift-default-74b74dcd4 from 0 to 1

openshift-ingress

multus

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-94929d65-7585756849

SuccessfulCreate

Created pod: payload-processing-e2e-derive-94929d65-7585756849-6qvfk

openshift-ingress

deployment-controller

payload-processing-e2e-derive-94929d65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-94929d65-7585756849 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-94929d65-7585756849-6qvfk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-94929d65-7585756849-6qvfk

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-94929d65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-94929d65-7b564c8878 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-94929d65-7b564c8878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

openshift-ingress

kubelet

payload-processing-e2e-derive-94929d65-7585756849-6qvfk

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-94929d65-7585756849

FailedCreate

Error creating: pods "payload-processing-e2e-derive-94929d65-7585756849-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-94929d65: serviceaccount "payload-processing-e2e-derive-94929d65" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-94929d65-7b564c8878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-94929d65-7b564c8878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-94929d65: serviceaccount "payload-processing-e2e-derive-94929d65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-94929d65-7585756849-6qvfk

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-94929d65-7585756849-6qvfk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-94929d65-openshift-default-74b74dcd4-8qx9r

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-94929d65-7b564c8878-jlrhl

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-026961cf-openshift-default-845f5469cb

SuccessfulCreate

Created pod: e2e-mt-026961cf-openshift-default-845f5469cb-d5968

openshift-ingress

deployment-controller

e2e-mt-026961cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-026961cf-openshift-default-845f5469cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-026961cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-026961cf

openshift-ingress

multus

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-026961cf-9b9fb45d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

openshift-ingress

multus

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-026961cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-026961cf-9b9fb45d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-026961cf-9b9fb45d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-026961cf-9b9fb45d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-026961cf: serviceaccount "payload-processing-e2e-mt-026961cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-026961cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-026961cf-fd9d7f66b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-026961cf: serviceaccount "payload-processing-e2e-mt-026961cf" not found

openshift-ingress

multus

payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-026961cf-fd9d7f66b-b8795

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-026961cf-9b9fb45d9-blmlh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-026961cf-openshift-default-845f5469cb-d5968

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w1-f5e6d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-f5e6d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-f5e6d4

openshift-ingress

replicaset-controller

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848

SuccessfulCreate

Created pod: e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-f5e6d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-f5e6d4: serviceaccount "payload-processing-e2e-shared-a-w1-f5e6d4" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-f5e6d4: serviceaccount "payload-processing-e2e-shared-a-w1-f5e6d4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-f5e6d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-de7535-6dcf799cf-mxln6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-de7535-c9768d786-f77j9

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-1f7000-openshift-default-5846598874

SuccessfulCreate

Created pod: e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

openshift-ingress

kubelet

e2e-inf-a-de7535-openshift-default-69b96cc448-mgt62

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w1-1f7000-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-1f7000-openshift-default-5846598874 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-1f7000

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-1f7000

openshift-ingress

multus

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-1f7000-b4c595565

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-1f7000: serviceaccount "payload-processing-e2e-shared-b-w1-1f7000" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-1f7000-b4c595565

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-1f7000-b4c595565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-1f7000: serviceaccount "payload-processing-e2e-shared-b-w1-1f7000" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-1f7000

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-1f7000-b4c595565 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-1f7000

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bcf02f-67b6566689-vv424

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bcf02f-589d4b798b-zgfhm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-011541-openshift-default-cbd47d786

SuccessfulCreate

Created pod: e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

openshift-ingress

kubelet

e2e-inf-b-bcf02f-openshift-default-67c665cd9d-vfxvb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-011541-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-011541-openshift-default-cbd47d786 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-011541

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-011541

openshift-ingress

multus

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Started

Started container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-011541-865b6668df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-011541-865b6668df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-011541: serviceaccount "payload-processing-e2e-shared-a-w2-011541" not found

openshift-ingress

deployment-controller

e2e-mt-6fa1a2a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6fa1a2a2-openshift-default-68448cb476 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-011541-865b6668df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-011541

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-011541-865b6668df from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6fa1a2a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6fa1a2a2

openshift-ingress

replicaset-controller

e2e-mt-6fa1a2a2-openshift-default-68448cb476

SuccessfulCreate

Created pod: e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-011541: serviceaccount "payload-processing-e2e-shared-a-w2-011541" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-011541

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6fa1a2a2: serviceaccount "payload-processing-e2e-mt-6fa1a2a2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6fa1a2a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6fa1a2a2-567b7b98b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6fa1a2a2: serviceaccount "payload-processing-e2e-mt-6fa1a2a2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6fa1a2a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6fa1a2a2-97598df86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

openshift-ingress

kubelet

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-99602c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-99602c

openshift-ingress

replicaset-controller

e2e-shared-b-w2-99602c-openshift-default-68db6f4458

SuccessfulCreate

Created pod: e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

openshift-ingress

deployment-controller

e2e-shared-b-w2-99602c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-99602c-openshift-default-68db6f4458 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-99602c: serviceaccount "payload-processing-e2e-shared-b-w2-99602c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-99602c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-99602c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-99602c-7bf756d877 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-99602c-7bf756d877

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-99602c-7bf756d877

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-99602c-7bf756d877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-99602c: serviceaccount "payload-processing-e2e-shared-b-w2-99602c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-039dbc-c8b479995-b22vm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-039dbc-77687f74bb-67x8z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w3-039dbc-openshift-default-78c6c5b876-gmc7l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-mt-6fa1a2a2-567b7b98b5-pjngb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6fa1a2a2-97598df86-dhdzt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-6fa1a2a2-openshift-default-68448cb476-w89st

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-37c153-559788cfd-7mvbb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-37c153

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-37c153: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-37c153": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-37c153, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b6fe0d44-b65d-427c-960f-0e329479644d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-37c153-59b57ff795-thwml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-37c153-openshift-default-67c588ff5b-qcns7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-e6108f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e6108f-openshift-default-595bc8bb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-e6108f-openshift-default-595bc8bb8

SuccessfulCreate

Created pod: e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

openshift-ingress

gateway_labeler_controller

e2e-api-a-e6108f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e6108f

openshift-ingress

multus

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e6108f-977b55475

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e6108f-977b55475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e6108f: serviceaccount "payload-processing-e2e-api-a-e6108f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e6108f: serviceaccount "payload-processing-e2e-api-a-e6108f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e6108f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e6108f-977b55475 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e6108f-977b55475

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e6108f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-29f0cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-29f0cb-openshift-default-767f888db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-29f0cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-29f0cb

openshift-ingress

replicaset-controller

e2e-api-b-29f0cb-openshift-default-767f888db

SuccessfulCreate

Created pod: e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

openshift-ingress

multus

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-29f0cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-29f0cb-786765bc9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-29f0cb-6866d56597

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-29f0cb-6866d56597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-29f0cb: serviceaccount "payload-processing-e2e-api-b-29f0cb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-29f0cb: serviceaccount "payload-processing-e2e-api-b-29f0cb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-29f0cb-6866d56597

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-29f0cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-29f0cb-6866d56597 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-e6108f-977b55475-7hjwj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e6108f-67cc9f8dd6-2bhw7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-e6108f-openshift-default-595bc8bb8-2c8fk

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-29f0cb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-29f0cb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-29f0cb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-29f0cb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 78e07539-0a79-49ad-b3ae-efe705a50bde, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-29f0cb-6866d56597-cm92f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29f0cb-786765bc9d-r6dld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-29f0cb-openshift-default-767f888db-7fkzh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-f5e6d4-7bbfb4c55-778vt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-f5e6d4-78c6696df8-2fw5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-f5e6d4-openshift-default-5f787bb848-c8mkv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-1f7000-7f68dfc46-p2drp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-1f7000-b4c595565-6mcrj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w1-1f7000-openshift-default-5846598874-2bmvc

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-15e8cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-15e8cc

openshift-ingress

replicaset-controller

e2e-ipp-a-15e8cc-openshift-default-6b665647bd

SuccessfulCreate

Created pod: e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

openshift-ingress

deployment-controller

e2e-ipp-a-15e8cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-15e8cc-openshift-default-6b665647bd from 0 to 1

openshift-ingress

multus

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-15e8cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-15e8cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-15e8cc-569fd84d6c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-15e8cc: serviceaccount "payload-processing-e2e-ipp-a-15e8cc" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-15e8cc: serviceaccount "payload-processing-e2e-ipp-a-15e8cc" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:50312->10.134.0.64:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:50312->10.134.0.64:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-46c63c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-46c63c

openshift-ingress

deployment-controller

e2e-ipp-b-46c63c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-46c63c-openshift-default-bdc9c597d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-46c63c-openshift-default-bdc9c597d

SuccessfulCreate

Created pod: e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

openshift-ingress

multus

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-46c63c: serviceaccount "payload-processing-e2e-ipp-b-46c63c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-46c63c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-46c63c-6866967f69 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-46c63c-6866967f69

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-46c63c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-46c63c-6446498d6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-46c63c-6866967f69

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-46c63c-6866967f69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-46c63c: serviceaccount "payload-processing-e2e-ipp-b-46c63c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-12b560

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-12b560

openshift-ingress

deployment-controller

e2e-ipp-cleanup-12b560-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

openshift-ingress

multus

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-12b560

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-12b560-6876ddc695 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-12b560

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-12b560: serviceaccount "payload-processing-e2e-ipp-cleanup-12b560" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-12b560: serviceaccount "payload-processing-e2e-ipp-cleanup-12b560" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Unhealthy

Startup probe failed: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

ProbeError

Startup probe error: Get "http://10.133.0.91:15021/healthz/ready": dial tcp 10.133.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-12b560-7fb98d64d6-6kgxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-12b560-6876ddc695-p6w79

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-12b560-openshift-default-65db5d8c5b-7sxmk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-15e8cc-569fd84d6c-drdm5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-15e8cc-746f8cfd78-f777c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-15e8cc-openshift-default-6b665647bd-z9kmh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-46c63c-6866967f69-2mnf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-46c63c-6446498d6-zc69t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-46c63c-openshift-default-bdc9c597d-cj4sq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-011541-65954d6c5d-f2q2h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-011541-865b6668df-c46rb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-011541-openshift-default-cbd47d786-kxc7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-99602c-66c978856b-kjttv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-99602c-7bf756d877-2jlzm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-99602c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-99602c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-99602c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-99602c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f6c65da-9ecb-44fe-b11d-3673db5a9329, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w2-99602c-openshift-default-68db6f4458-9sslr

Killing

Stopping container istio-proxy