Time Namespace Component RelatedObject Reason Message

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-292146-854b75bf69-rxscn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-292146-854b75bf69-rxscn to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn to ip-10-0-129-37.ec2.internal

openshift-ingress

kube-auth-proxy-6b786b9564-lhwbt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6b786b9564-lhwbt to ip-10-0-139-21.ec2.internal

openshift-ingress

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt to ip-10-0-139-21.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9pkn8 to ip-10-0-139-21.ec2.internal

openshift-ingress

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9 to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-519912e2-openshift-default-866d855bc6-27sg2 to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8 to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2 to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf to ip-10-0-139-21.ec2.internal

openshift-ingress

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2 to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56 to ip-10-0-139-21.ec2.internal

openshift-ingress

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78 to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42 to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk to ip-10-0-132-49.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-wqlz6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wqlz6 to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f to ip-10-0-132-49.ec2.internal

openshift-ingress

kube-auth-proxy-6b786b9564-bsppv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6b786b9564-bsppv to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9 to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-qsknm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-qsknm to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4 to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz to ip-10-0-139-21.ec2.internal

openshift-ingress

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-twfmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-twfmq to ip-10-0-132-49.ec2.internal

openshift-ingress

router-default-685768998d-vj8pc

Scheduled

Successfully assigned openshift-ingress/router-default-685768998d-vj8pc to ip-10-0-139-21.ec2.internal

openshift-ingress

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26 to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-processing-e2e-derive-49880939-7587875649-nffhw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-49880939-7587875649-nffhw to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr to ip-10-0-129-37.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-z44wc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-z44wc to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8 to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-917b58-openshift-default-5d787b6678-hl8zq to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

Scheduled

Successfully assigned openshift-ingress/e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks to ip-10-0-139-21.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg to ip-10-0-132-49.ec2.internal

openshift-ingress

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Scheduled

Successfully assigned openshift-ingress/e2e-derive-49880939-openshift-default-548d944c4d-dzh8g to ip-10-0-129-37.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8 to ip-10-0-132-49.ec2.internal

openshift-ingress

payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs to ip-10-0-129-37.ec2.internal

openshift-ingress

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm to ip-10-0-139-21.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-685768998d from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-685768998d

FailedCreate

Error creating: pods "router-default-685768998d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-685768998d

FailedCreate

Error creating: pods "router-default-685768998d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-685768998d

SuccessfulCreate

Created pod: router-default-685768998d-vj8pc
(x5)

openshift-ingress

kubelet

router-default-685768998d-vj8pc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-685768998d-vj8pc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-685768998d-vj8pc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-685768998d-vj8pc

Created

Created container: router

openshift-ingress

multus

router-default-685768998d-vj8pc

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-685768998d-vj8pc

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-6b786b9564

SuccessfulCreate

Created pod: kube-auth-proxy-6b786b9564-bsppv
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-6b786b9564

FailedCreate

Error creating: pods "kube-auth-proxy-6b786b9564-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6b786b9564

SuccessfulCreate

Created pod: kube-auth-proxy-6b786b9564-lhwbt

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-bsppv

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-lhwbt

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6b786b9564 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-lhwbt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6b786b9564-bsppv

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-bsppv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6b786b9564-lhwbt

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-wqlz6

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-wqlz6

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-lhwbt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-bsppv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.634s (2.634s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-bsppv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-lhwbt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.719s (2.719s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-bsppv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6b786b9564-lhwbt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-z44wc

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 13.76s (13.76s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z44wc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-z44wc

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z44wc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z44wc

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z44wc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.155s (2.155s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z44wc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-z44wc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-wqlz6

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wqlz6

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.648s (4.648s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-pzrrb

Started

Started container istio-proxy
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9pkn8

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-twfmq

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-qsknm
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-twfmq

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qsknm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-qsknm

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twfmq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qsknm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twfmq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.119s (1.119s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qsknm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qsknm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.146s (1.146s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twfmq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-twfmq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9pkn8

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78

SuccessfulCreate

Created pod: e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-c5fdd3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-c5fdd3

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-f9cf33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-f9cf33

openshift-ingress

deployment-controller

e2e-worker-w4-f9cf33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-f9cf33-openshift-default-655b77d4b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4

SuccessfulCreate

Created pod: e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

openshift-ingress

gateway_labeler_controller

e2e-inf-a-eac715

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-eac715

openshift-ingress

deployment-controller

e2e-inf-a-eac715-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-eac715-openshift-default-6c955b8b7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-eac715-openshift-default-6c955b8b7d

SuccessfulCreate

Created pod: e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

openshift-ingress

deployment-controller

e2e-worker-w0-c5fdd3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-eac715-66798f9f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-eac715-66798f9f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-eac715: serviceaccount "payload-processing-e2e-inf-a-eac715" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-eac715

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-eac715-5fd5cffc5c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-eac715-5fd5cffc5c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-eac715-5fd5cffc5c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-eac715-5fd5cffc5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-eac715: serviceaccount "payload-processing-e2e-inf-a-eac715" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-eac715-66798f9f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-eac715

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-eac715-66798f9f58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f9cf33: serviceaccount "payload-processing-e2e-worker-w4-f9cf33" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-f9cf33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-f9cf33-86d45b94d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-f9cf33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f9cf33: serviceaccount "payload-processing-e2e-worker-w4-f9cf33" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-c5fdd3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c5fdd3: serviceaccount "payload-processing-e2e-worker-w0-c5fdd3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-c5fdd3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-c5fdd3: serviceaccount "payload-processing-e2e-worker-w0-c5fdd3" not found

openshift-ingress

multus

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-917b58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-917b58

openshift-ingress

deployment-controller

e2e-autores-917b58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-917b58-openshift-default-5d787b6678 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-917b58-openshift-default-5d787b6678

SuccessfulCreate

Created pod: e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-519912e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-519912e2

openshift-ingress

deployment-controller

e2e-ait-519912e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-519912e2-openshift-default-866d855bc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-519912e2-openshift-default-866d855bc6

SuccessfulCreate

Created pod: e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

openshift-ingress

multus

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.53s (2.53s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.719s (2.719s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-autores-917b58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-917b58-757bf8cb8f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-917b58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-917b58-879dfc946 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-917b58-757bf8cb8f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-917b58-757bf8cb8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-917b58: serviceaccount "payload-processing-e2e-autores-917b58" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-917b58-879dfc946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-917b58-879dfc946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-917b58: serviceaccount "payload-processing-e2e-autores-917b58" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-917b58-757bf8cb8f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-917b58-879dfc946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-519912e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-519912e2-557989fc8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-519912e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-519912e2-66ff84bcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-519912e2-66ff84bcf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-519912e2-557989fc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-519912e2-557989fc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-519912e2: serviceaccount "payload-processing-e2e-ait-519912e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-519912e2-557989fc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-519912e2-66ff84bcf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-519912e2-66ff84bcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-519912e2: serviceaccount "payload-processing-e2e-ait-519912e2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-44d735-openshift-default-7c6c894d98

SuccessfulCreate

Created pod: e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

openshift-ingress

deployment-controller

e2e-inf-b-44d735-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-44d735-openshift-default-7c6c894d98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-44d735

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-44d735

openshift-ingress

multus

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-44d735

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-44d735-5b9bdd8c89

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-44d735: serviceaccount "payload-processing-e2e-inf-b-44d735" not found
(x2)

openshift-ingress

kubelet

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-44d735-5b9bdd8c89

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-44d735-5b9bdd8c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-44d735: serviceaccount "payload-processing-e2e-inf-b-44d735" not found
(x2)

openshift-ingress

kubelet

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-44d735

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-44d735-5b9bdd8c89 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-519912e2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-519912e2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-519912e2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-519912e2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8d9ced2c-db1c-4ddf-abf9-3a6441a0f4d6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-519912e2-557989fc8b-8ph5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-519912e2-66ff84bcf-kqbvs

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-67d98638-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-67d98638-gw

openshift-ingress

deployment-controller

e2e-migrate-67d98638-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-67d98638-gw-openshift-default-66d88858d8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-519912e2-openshift-default-866d855bc6-27sg2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-67d98638-gw-openshift-default-66d88858d8

SuccessfulCreate

Created pod: e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9
(x2)

openshift-ingress

kubelet

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-67d98638-7597c7d646

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

openshift-ingress

multus

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-67d98638-7597c7d646

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-67d98638-7597c7d646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-67d98638: serviceaccount "payload-processing-e2e-migrate-67d98638" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-67d98638: serviceaccount "payload-processing-e2e-migrate-67d98638" not found
(x5)

openshift-ingress

kubelet

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-67d98638

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-67d98638

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-67d98638-7597c7d646 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-67d98638-84b8cbfc74-gpclg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-67d98638-7597c7d646-9mwgs

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-9d0906fb-openshift-default-549dc59cd4

SuccessfulCreate

Created pod: e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-9d0906fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9d0906fb

openshift-ingress

deployment-controller

e2e-ait-9d0906fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9d0906fb-openshift-default-549dc59cd4 from 0 to 1

openshift-ingress

multus

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-67d98638-gw-openshift-default-66d88858d8-kqtv9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9d0906fb-96fc4b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9d0906fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9d0906fb-96fc4b7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9d0906fb: serviceaccount "payload-processing-e2e-ait-9d0906fb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9d0906fb-96fc4b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9d0906fb-96fc4b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9d0906fb: serviceaccount "payload-processing-e2e-ait-9d0906fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9d0906fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9d0906fb-67568f79f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-9d0906fb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-9d0906fb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-9d0906fb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-9d0906fb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5dbcfcbc-1b67-4e90-b822-0edc06d0d90b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-9d0906fb-96fc4b7-j5xgp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9d0906fb-67568f79f8-jbhnr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-49880939

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-49880939

openshift-ingress

deployment-controller

e2e-derive-49880939-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-49880939-openshift-default-548d944c4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-49880939-openshift-default-548d944c4d

SuccessfulCreate

Created pod: e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-9d0906fb-openshift-default-549dc59cd4-dm6lf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-917b58-879dfc946-rz6sk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-917b58-757bf8cb8f-j5qj2

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-49880939-7587875649

SuccessfulCreate

Created pod: payload-processing-e2e-derive-49880939-7587875649-nffhw

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-49880939-7587875649-nffhw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-49880939

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-49880939-bb6965b8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-49880939-bb6965b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-49880939-bb6965b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-49880939-bb6965b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-49880939: serviceaccount "payload-processing-e2e-derive-49880939" not found

openshift-ingress

multus

payload-processing-e2e-derive-49880939-7587875649-nffhw

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-49880939

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-49880939-7587875649 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-49880939-7587875649

FailedCreate

Error creating: pods "payload-processing-e2e-derive-49880939-7587875649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-49880939: serviceaccount "payload-processing-e2e-derive-49880939" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-49880939-7587875649-nffhw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-49880939-7587875649-nffhw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-49880939-7587875649-nffhw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-49880939

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-49880939: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-49880939": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-49880939, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c662d494-c321-49bd-8f71-53b0451fbb54, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-49880939-bb6965b8b-mr29f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-49880939-openshift-default-548d944c4d-dzh8g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-explicit-292146

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-292146

openshift-ingress

kubelet

e2e-autores-917b58-openshift-default-5d787b6678-hl8zq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-292146-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-292146-openshift-default-5f6bc89c68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-292146-openshift-default-5f6bc89c68

SuccessfulCreate

Created pod: e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

openshift-ingress

multus

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-292146

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-292146-854b75bf69

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-292146-854b75bf69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-292146: serviceaccount "payload-processing-e2e-explicit-292146" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-292146: serviceaccount "payload-processing-e2e-explicit-292146" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-292146

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-292146-854b75bf69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-292146-854b75bf69

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-292146-854b75bf69-rxscn

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-292146-854b75bf69-rxscn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-292146-854b75bf69-rxscn

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-292146-854b75bf69-rxscn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-292146-854b75bf69-rxscn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-939c7fd8-openshift-default-77d96bb456

SuccessfulCreate

Created pod: e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

openshift-ingress

gateway_labeler_controller

e2e-mt-939c7fd8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-939c7fd8

openshift-ingress

deployment-controller

e2e-mt-939c7fd8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-939c7fd8-openshift-default-77d96bb456 from 0 to 1

openshift-ingress

multus

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-939c7fd8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-939c7fd8-679b99c6bf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-939c7fd8-679b99c6bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-939c7fd8-679b99c6bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-939c7fd8: serviceaccount "payload-processing-e2e-mt-939c7fd8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-939c7fd8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-939c7fd8-559d689cfd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-939c7fd8: serviceaccount "payload-processing-e2e-mt-939c7fd8" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-939c7fd8-679b99c6bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

openshift-ingress

kubelet

payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z
(x2)

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-292146-5cbbf6ccc8-fjmm9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-292146-854b75bf69-rxscn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-292146-openshift-default-5f6bc89c68-t5x78

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-233c27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-233c27-openshift-default-685cb96dcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-233c27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-233c27

openshift-ingress

replicaset-controller

e2e-noten-233c27-openshift-default-685cb96dcb

SuccessfulCreate

Created pod: e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

openshift-ingress

multus

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-939c7fd8-559d689cfd-fpl4z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-939c7fd8-679b99c6bf-2vcb4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-939c7fd8-openshift-default-77d96bb456-h7jrt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-8faaa1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546

SuccessfulCreate

Created pod: e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-8faaa1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-8faaa1

openshift-ingress

multus

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-8faaa1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8faaa1: serviceaccount "payload-processing-e2e-shared-a-w2-8faaa1" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-8faaa1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-8faaa1: serviceaccount "payload-processing-e2e-shared-a-w2-8faaa1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-20531f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-20531f

openshift-ingress

replicaset-controller

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6

SuccessfulCreate

Created pod: e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

openshift-ingress

deployment-controller

e2e-shared-b-w2-20531f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-20531f: serviceaccount "payload-processing-e2e-shared-b-w2-20531f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-20531f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-20531f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-20531f-6d974c5665 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-20531f-6d974c5665

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-20531f-6d974c5665

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-20531f-6d974c5665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-20531f: serviceaccount "payload-processing-e2e-shared-b-w2-20531f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-eac715-66798f9f58-x9tcn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-eac715-5fd5cffc5c-4sw2n

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-20e1128a-openshift-default-7bf58544bd

SuccessfulCreate

Created pod: e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

openshift-ingress

deployment-controller

e2e-mt-20e1128a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-20e1128a-openshift-default-7bf58544bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-20e1128a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-20e1128a

openshift-ingress

kubelet

e2e-inf-a-eac715-openshift-default-6c955b8b7d-qdptc

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-20e1128a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-20e1128a-6896d4f574 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-20e1128a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-20e1128a-7f4d7ff4b5 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-20e1128a: serviceaccount "payload-processing-e2e-mt-20e1128a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-20e1128a-6896d4f574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

openshift-ingress

multus

payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-20e1128a-6896d4f574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-20e1128a-6896d4f574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-20e1128a: serviceaccount "payload-processing-e2e-mt-20e1128a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-233c27-openshift-default-685cb96dcb-vzsgc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-44d735-5b9bdd8c89-2xkrn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-44d735-7b59bb74fd-fk22w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-44d735-openshift-default-7c6c894d98-l5phm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d6c0ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d6c0ac

openshift-ingress

deployment-controller

e2e-shared-a-w3-d6c0ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b

SuccessfulCreate

Created pod: e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

openshift-ingress

multus

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d6c0ac: serviceaccount "payload-processing-e2e-shared-a-w3-d6c0ac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d6c0ac: serviceaccount "payload-processing-e2e-shared-a-w3-d6c0ac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d6c0ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d6c0ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-a91c21-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48

SuccessfulCreate

Created pod: e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-a91c21

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-a91c21

openshift-ingress

multus

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a91c21: serviceaccount "payload-processing-e2e-shared-b-w3-a91c21" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-a91c21

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-a91c21-6987df6979 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-a91c21-6987df6979

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-a91c21-6987df6979

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-a91c21-6987df6979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a91c21: serviceaccount "payload-processing-e2e-shared-b-w3-a91c21" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-a91c21

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20e1128a-6896d4f574-z7ggd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-20e1128a-7f4d7ff4b5-blrtp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-20e1128a-openshift-default-7bf58544bd-q6hxt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd

SuccessfulCreate

Created pod: e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

openshift-ingress

deployment-controller

e2e-api-a-37cf0f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-37cf0f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-37cf0f

openshift-ingress

multus

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-37cf0f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-37cf0f-f9dfc6fbf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-37cf0f-69f548795d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-37cf0f-69f548795d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-37cf0f: serviceaccount "payload-processing-e2e-api-a-37cf0f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-37cf0f-69f548795d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-37cf0f: serviceaccount "payload-processing-e2e-api-a-37cf0f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-37cf0f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-37cf0f-69f548795d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-d90856

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d90856

openshift-ingress

deployment-controller

e2e-api-b-d90856-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d90856-openshift-default-5c9f79697d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-d90856-openshift-default-5c9f79697d

SuccessfulCreate

Created pod: e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

openshift-ingress

multus

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d90856-5779bc7854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d90856-5779bc7854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d90856: serviceaccount "payload-processing-e2e-api-b-d90856" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d90856-6ccd4dbdbf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d90856-6ccd4dbdbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d90856: serviceaccount "payload-processing-e2e-api-b-d90856" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d90856-5779bc7854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d90856

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d90856-5779bc7854 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d90856

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d90856-6ccd4dbdbf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d90856-6ccd4dbdbf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-c5fdd3-54bbb687cc-8hcbq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-c5fdd3-77674d5b94-c7vjc

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-c5fdd3-openshift-default-5c9c459b78-dprfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-37cf0f-f9dfc6fbf-jnhzf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-37cf0f-69f548795d-zlwj8

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : configmap "payload-processing-plugins-e2e-api-a-37cf0f" not found

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-37cf0f-openshift-default-6c6d6ffdcd-96g56

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d90856-5779bc7854-8p4hn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d90856-6ccd4dbdbf-spf7z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-d90856-openshift-default-5c9f79697d-fh2qz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-8faaa1-5c8b795957-nvdfx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-8faaa1-67f9b88f8-cd4s2

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-8faaa1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8faaa1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-8faaa1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8faaa1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 89f6d341-b06c-4f70-8c0c-ea0c7eb194b8, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-8faaa1-openshift-default-5d964d9546-pcp42

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-20531f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-20531f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-20531f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-20531f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 25b5efe0-a2c7-467c-b87a-8ce8b54b03ed, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-20531f-776868bd6-9zvzq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-20531f-6d974c5665-ldnmr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-20531f-openshift-default-5d6fd9c6d6-xjg7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f9cf33-6f76c48d58-fvkpb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f9cf33-86d45b94d7-2cksg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-f9cf33-openshift-default-655b77d4b4-7vzdk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e1f79c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e1f79c

openshift-ingress

replicaset-controller

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d

SuccessfulCreate

Created pod: e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

openshift-ingress

deployment-controller

e2e-ipp-a-e1f79c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e1f79c-openshift-default-6b94c7566d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e1f79c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e1f79c-7977b4459f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e1f79c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e1f79c: serviceaccount "payload-processing-e2e-ipp-a-e1f79c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e1f79c-7977b4459f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e1f79c-7977b4459f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e1f79c: serviceaccount "payload-processing-e2e-ipp-a-e1f79c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e1f79c-7977b4459f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

ProbeError

Readiness probe error: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Unhealthy

Readiness probe failed: Get "http://10.132.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Unhealthy

Startup probe failed: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

ProbeError

Startup probe error: Get "http://10.132.0.89:15021/healthz/ready": dial tcp 10.132.0.89:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-36f843-openshift-default-7c75f76888

SuccessfulCreate

Created pod: e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-36f843

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-36f843

openshift-ingress

deployment-controller

e2e-ipp-b-36f843-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-36f843-openshift-default-7c75f76888 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-36f843

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-36f843-586fd4f867 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-36f843

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-36f843-749fcd446b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-36f843: serviceaccount "payload-processing-e2e-ipp-b-36f843" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-36f843-586fd4f867

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-36f843-586fd4f867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-36f843: serviceaccount "payload-processing-e2e-ipp-b-36f843" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-36f843-586fd4f867

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-f696b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-f696b1

openshift-ingress

deployment-controller

e2e-ipp-cleanup-f696b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-f696b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f696b1: serviceaccount "payload-processing-e2e-ipp-cleanup-f696b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f696b1: serviceaccount "payload-processing-e2e-ipp-cleanup-f696b1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-f696b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f696b1-57d88c468b-26pmq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f696b1-c5976ddf9-rvrsw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-f696b1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f696b1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-f696b1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f696b1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7ce52cd8-5390-4db7-86ab-c3c1f96fd5d3, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-f696b1-openshift-default-59ccdcc9fb-hcjrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e1f79c-7977b4459f-pbsz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e1f79c-79cd7f5974-4pqqb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-e1f79c-openshift-default-6b94c7566d-cvdfz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-36f843-586fd4f867-qpvcn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-36f843-749fcd446b-ngwsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-36f843-openshift-default-7c75f76888-qjn26

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d6c0ac-6667bf46fd-g8tlz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d6c0ac-6db494dc65-w9frb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-d6c0ac-openshift-default-78496c496b-ksjks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a91c21-6987df6979-8tsq8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a91c21-7689d9b9cd-vvsgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-a91c21-openshift-default-6b7b44d48-j2jnh

Killing

Stopping container istio-proxy