Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl to ip-10-0-128-233.ec2.internal

openshift-ingress

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw to ip-10-0-128-233.ec2.internal

openshift-ingress

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr to ip-10-0-128-233.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-crrwm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-crrwm to ip-10-0-128-233.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-z6cj4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4 to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx to ip-10-0-128-233.ec2.internal

openshift-ingress

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8 to ip-10-0-128-233.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-00d34b-54f9774875-rc782

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-00d34b-54f9774875-rc782 to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

Scheduled

Successfully assigned openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv to ip-10-0-133-33.ec2.internal

openshift-ingress

kube-auth-proxy-55b8d65647-7mdqg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-55b8d65647-7mdqg to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 to ip-10-0-133-33.ec2.internal

openshift-ingress

payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5 to ip-10-0-139-248.ec2.internal

openshift-ingress

router-default-6454dbbfc8-27mq8

Scheduled

Successfully assigned openshift-ingress/router-default-6454dbbfc8-27mq8 to ip-10-0-133-33.ec2.internal

openshift-ingress

kube-auth-proxy-55b8d65647-rj8qn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7 to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6824f488-openshift-default-846cb44784-qxw7x to ip-10-0-128-233.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-k5pcr to ip-10-0-128-233.ec2.internal

openshift-ingress

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n to ip-10-0-133-33.ec2.internal

openshift-ingress

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 to ip-10-0-133-33.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-x9jm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-x9jm5 to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9 to ip-10-0-128-233.ec2.internal

openshift-ingress

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq to ip-10-0-133-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8 to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98 to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp to ip-10-0-133-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs to ip-10-0-128-233.ec2.internal

openshift-ingress

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2 to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7 to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6824f488-847dd44849-cpgg7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6824f488-847dd44849-cpgg7 to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

Scheduled

Successfully assigned openshift-ingress/e2e-autores-6114ed-openshift-default-788fc9544-bsrf4 to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6 to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b75118e5-548956f75d-944vs to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872 to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm to ip-10-0-139-248.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-kd6gq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-kd6gq to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2 to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd to ip-10-0-139-248.ec2.internal

openshift-ingress

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

Scheduled

Successfully assigned openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f to ip-10-0-133-33.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v to ip-10-0-128-233.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd to ip-10-0-128-233.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6454dbbfc8 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-6454dbbfc8

FailedCreate

Error creating: pods "router-default-6454dbbfc8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6454dbbfc8

FailedCreate

Error creating: pods "router-default-6454dbbfc8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6454dbbfc8

SuccessfulCreate

Created pod: router-default-6454dbbfc8-27mq8
(x6)

openshift-ingress

kubelet

router-default-6454dbbfc8-27mq8

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6454dbbfc8-27mq8

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-6454dbbfc8-27mq8

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6454dbbfc8-27mq8

Started

Started container router

openshift-ingress

kubelet

router-default-6454dbbfc8-27mq8

Created

Created container: router

openshift-ingress

kubelet

router-default-6454dbbfc8-27mq8

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-55b8d65647

SuccessfulCreate

Created pod: kube-auth-proxy-55b8d65647-7mdqg

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-55b8d65647 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-55b8d65647

SuccessfulCreate

Created pod: kube-auth-proxy-55b8d65647-rj8qn
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-55b8d65647

FailedCreate

Error creating: pods "kube-auth-proxy-55b8d65647-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-7mdqg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-rj8qn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-55b8d65647-7mdqg

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-55b8d65647-rj8qn

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-z6cj4

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-7mdqg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-rj8qn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-7mdqg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-7mdqg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.841s (2.841s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-rj8qn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-55b8d65647-rj8qn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.78s (2.78s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-z6cj4

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.778s (2.778s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nkdvq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.626s (2.626s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-crrwm

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-crrwm

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-crrwm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-crrwm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-crrwm

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-crrwm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.116s (2.116s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-crrwm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-crrwm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-z6cj4

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z6cj4

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-k5pcr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kd6gq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x9jm5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-kd6gq
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-x9jm5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-x9jm5

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-kd6gq

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x9jm5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.146s (1.146s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x9jm5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-x9jm5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kd6gq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kd6gq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-kd6gq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.442s (1.442s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-k5pcr

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-7ab633

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-7ab633

openshift-ingress

deployment-controller

e2e-worker-w4-7ab633-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-7ab633-openshift-default-d68f89768 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-0b4d93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7aa654

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7aa654

openshift-ingress

deployment-controller

e2e-inf-a-7aa654-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7aa654-openshift-default-5bb856cfd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-7aa654-openshift-default-5bb856cfd6

SuccessfulCreate

Created pod: e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

openshift-ingress

replicaset-controller

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd

SuccessfulCreate

Created pod: e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-0b4d93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-0b4d93

openshift-ingress

replicaset-controller

e2e-worker-w4-7ab633-openshift-default-d68f89768

SuccessfulCreate

Created pod: e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.705s (2.705s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-7ab633

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7ab633-68894c99c5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

openshift-ingress

multus

payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7ab633-68894c99c5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-7ab633-68894c99c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7ab633: serviceaccount "payload-processing-e2e-worker-w4-7ab633" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-7ab633

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-7ab633-68894c99c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7ab633: serviceaccount "payload-processing-e2e-worker-w4-7ab633" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7aa654

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7aa654

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7aa654-5995d54bbf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7aa654: serviceaccount "payload-processing-e2e-inf-a-7aa654" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7aa654-5995d54bbf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7aa654-5995d54bbf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7aa654-5995d54bbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7aa654: serviceaccount "payload-processing-e2e-inf-a-7aa654" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-autores-6114ed-openshift-default-788fc9544

SuccessfulCreate

Created pod: e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

openshift-ingress

gateway_labeler_controller

e2e-autores-6114ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-6114ed

openshift-ingress

deployment-controller

e2e-autores-6114ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-6114ed-openshift-default-788fc9544 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-f10a7edb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f10a7edb

openshift-ingress

deployment-controller

e2e-ait-f10a7edb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f10a7edb-openshift-default-56957656f6 from 0 to 1

openshift-ingress

multus

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-f10a7edb-openshift-default-56957656f6

SuccessfulCreate

Created pod: e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-0b4d93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-0b4d93-6749f94779 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-0b4d93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6 from 0 to 1

openshift-ingress

multus

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-0b4d93-6749f94779

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-0b4d93-6749f94779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-0b4d93: serviceaccount "payload-processing-e2e-worker-w0-0b4d93" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-0b4d93-6749f94779

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

openshift-ingress

multus

payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-0b4d93: serviceaccount "payload-processing-e2e-worker-w0-0b4d93" not found

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.928s (2.928s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f10a7edb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f10a7edb-89859c5c5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-6114ed-b5574bd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-6114ed-b5574bd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-6114ed: serviceaccount "payload-processing-e2e-autores-6114ed" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-6114ed-b5574bd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-6114ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-6114ed-b5574bd74 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-autores-6114ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-6114ed-55d5d84bc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-6114ed-55d5d84bc9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-6114ed-55d5d84bc9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-6114ed-55d5d84bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-6114ed: serviceaccount "payload-processing-e2e-autores-6114ed" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f10a7edb-89859c5c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f10a7edb-89859c5c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f10a7edb: serviceaccount "payload-processing-e2e-ait-f10a7edb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f10a7edb-89859c5c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f10a7edb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f10a7edb-657fc869b6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f10a7edb: serviceaccount "payload-processing-e2e-ait-f10a7edb" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:56710->10.133.0.43:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:56710->10.133.0.43:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-8fc0d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8fc0d3-openshift-default-db59cbf8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8fc0d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8fc0d3

openshift-ingress

replicaset-controller

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d

SuccessfulCreate

Created pod: e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

openshift-ingress

multus

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8fc0d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8fc0d3-558b678bd7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8fc0d3: serviceaccount "payload-processing-e2e-inf-b-8fc0d3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8fc0d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8fc0d3-558b678bd7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

openshift-ingress

multus

payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8fc0d3-558b678bd7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8fc0d3-558b678bd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8fc0d3: serviceaccount "payload-processing-e2e-inf-b-8fc0d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f10a7edb-657fc869b6-4972j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f10a7edb-89859c5c5-vntv8

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84

SuccessfulCreate

Created pod: e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

openshift-ingress

deployment-controller

e2e-migrate-b75118e5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-b75118e5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b75118e5-gw

openshift-ingress

kubelet

e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b75118e5: serviceaccount "payload-processing-e2e-migrate-b75118e5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b75118e5-548956f75d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b75118e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b75118e5-548956f75d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b75118e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b75118e5-548956f75d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b75118e5-548956f75d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b75118e5: serviceaccount "payload-processing-e2e-migrate-b75118e5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b75118e5-5cc5d65c66-w7xxl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-b75118e5-548956f75d-944vs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-92cb6c75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-92cb6c75-openshift-default-6b85594bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-92cb6c75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-92cb6c75

openshift-ingress

replicaset-controller

e2e-ait-92cb6c75-openshift-default-6b85594bb

SuccessfulCreate

Created pod: e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

openshift-ingress

multus

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-92cb6c75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-92cb6c75-75c6957c46 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-92cb6c75-8697448cb5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-92cb6c75-8697448cb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-92cb6c75: serviceaccount "payload-processing-e2e-ait-92cb6c75" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-92cb6c75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-92cb6c75-8697448cb5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-92cb6c75-8697448cb5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-92cb6c75: serviceaccount "payload-processing-e2e-ait-92cb6c75" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-92cb6c75-8697448cb5-hgv6x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92cb6c75-75c6957c46-9jg6t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-57a4f2d1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-57a4f2d1

openshift-ingress

replicaset-controller

e2e-derive-57a4f2d1-openshift-default-86c85b5c44

SuccessfulCreate

Created pod: e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

openshift-ingress

multus

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-57a4f2d1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-57a4f2d1-openshift-default-86c85b5c44 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-57a4f2d1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-57a4f2d1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-57a4f2d1-7564f488b9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-6114ed-55d5d84bc9-ftjcw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-6114ed-b5574bd74-82cj8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-57a4f2d1-7564f488b9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-57a4f2d1-7564f488b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-57a4f2d1: serviceaccount "payload-processing-e2e-derive-57a4f2d1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-57a4f2d1-7564f488b9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

openshift-ingress

kubelet

payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-57a4f2d1: serviceaccount "payload-processing-e2e-derive-57a4f2d1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-f324fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f324fe

openshift-ingress

replicaset-controller

e2e-explicit-f324fe-openshift-default-854bc57c6d

SuccessfulCreate

Created pod: e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

openshift-ingress

deployment-controller

e2e-explicit-f324fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f324fe-openshift-default-854bc57c6d from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-f324fe

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-f324fe-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-f324fe-authn-ssl" already exists

openshift-ingress

kubelet

e2e-autores-6114ed-openshift-default-788fc9544-bsrf4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f324fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f324fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f324fe-685449dd65 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

Started

Started container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f324fe-685449dd65

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f324fe-685449dd65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f324fe: serviceaccount "payload-processing-e2e-explicit-f324fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f324fe-685449dd65

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f324fe: serviceaccount "payload-processing-e2e-explicit-f324fe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

openshift-ingress

kubelet

payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-57a4f2d1-7564f488b9-tckdw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-57a4f2d1-5f5499789d-zzfqb

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-57a4f2d1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-57a4f2d1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-57a4f2d1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-57a4f2d1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eed040a5-da19-4003-9e20-432d974675ed, UID in object meta:

openshift-ingress

kubelet

e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-700887b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-700887b8

openshift-ingress

deployment-controller

e2e-mt-700887b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-700887b8-openshift-default-5b6464f868 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-700887b8-openshift-default-5b6464f868

SuccessfulCreate

Created pod: e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

openshift-ingress

multus

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-f324fe

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-f324fe: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-f324fe": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-f324fe, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 50b74f21-65b6-49f0-90be-c3dedf6428b1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f324fe-5bd7c9f4f4-mttpc

Unhealthy

Readiness probe failed: dial tcp 10.133.0.59:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-f324fe-685449dd65-vr8kl

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-700887b8-76d75bfd86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-700887b8-76d75bfd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-700887b8: serviceaccount "payload-processing-e2e-mt-700887b8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-700887b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-700887b8-6f44bd6c7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-700887b8-6f44bd6c7c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-700887b8-6f44bd6c7c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-700887b8-6f44bd6c7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-700887b8: serviceaccount "payload-processing-e2e-mt-700887b8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-700887b8-76d75bfd86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-700887b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-700887b8-76d75bfd86 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-b6f859-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-b6f859-openshift-default-6d787fd5bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-b6f859

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-b6f859

openshift-ingress

replicaset-controller

e2e-noten-b6f859-openshift-default-6d787fd5bd

SuccessfulCreate

Created pod: e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

openshift-ingress

multus

e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-700887b8-6f44bd6c7c-jtzjb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-700887b8-76d75bfd86-drlcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb

SuccessfulCreate

Created pod: e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

openshift-ingress

deployment-controller

e2e-shared-a-w2-09c1c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-09c1c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-09c1c1

openshift-ingress

multus

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-09c1c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-09c1c1: serviceaccount "payload-processing-e2e-shared-a-w2-09c1c1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-09c1c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-09c1c1: serviceaccount "payload-processing-e2e-shared-a-w2-09c1c1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-55130c-openshift-default-55b844f76b

SuccessfulCreate

Created pod: e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

openshift-ingress

deployment-controller

e2e-shared-b-w2-55130c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-55130c-openshift-default-55b844f76b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-55130c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-55130c

openshift-ingress

multus

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-55130c: serviceaccount "payload-processing-e2e-shared-b-w2-55130c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-55130c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-55130c: serviceaccount "payload-processing-e2e-shared-b-w2-55130c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-55130c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7aa654-7d4c68d78-jt6cs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7aa654-5995d54bbf-kw9n5

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-6824f488-openshift-default-846cb44784

SuccessfulCreate

Created pod: e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

openshift-ingress

deployment-controller

e2e-mt-6824f488-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6824f488-openshift-default-846cb44784 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6824f488

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6824f488

openshift-ingress

multus

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-7aa654-openshift-default-5bb856cfd6-hqtbx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6824f488-787c5fd66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6824f488-787c5fd66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6824f488-787c5fd66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6824f488: serviceaccount "payload-processing-e2e-mt-6824f488" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6824f488

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6824f488-847dd44849 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6824f488-847dd44849

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6824f488-847dd44849-cpgg7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6824f488-847dd44849

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6824f488-847dd44849-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6824f488: serviceaccount "payload-processing-e2e-mt-6824f488" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6824f488

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6824f488-787c5fd66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-6824f488-847dd44849-cpgg7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6824f488-847dd44849-cpgg7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-6824f488-847dd44849-cpgg7

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6824f488-847dd44849-cpgg7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8fc0d3-558b678bd7-svxld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8fc0d3-7596c7c56b-h5z8v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-8fc0d3-openshift-default-db59cbf8d-l4z2j

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-e5aae7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-e5aae7

openshift-ingress

deployment-controller

e2e-shared-a-w3-e5aae7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd

SuccessfulCreate

Created pod: e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e5aae7: serviceaccount "payload-processing-e2e-shared-a-w3-e5aae7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-e5aae7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-e5aae7-574b759d99 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-e5aae7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-e5aae7: serviceaccount "payload-processing-e2e-shared-a-w3-e5aae7" not found
(x2)

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-6275e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-6275e9

openshift-ingress

deployment-controller

e2e-shared-b-w3-6275e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78

SuccessfulCreate

Created pod: e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

openshift-ingress

multus

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-6275e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6275e9: serviceaccount "payload-processing-e2e-shared-b-w3-6275e9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-6275e9: serviceaccount "payload-processing-e2e-shared-b-w3-6275e9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-6275e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-6824f488

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-6824f488: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-6824f488": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-6824f488, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cb776fd7-34dd-44c4-9d10-612fa065389f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-6824f488-847dd44849-cpgg7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6824f488-787c5fd66-nx9f2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-6824f488-openshift-default-846cb44784-qxw7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-eb0661

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-eb0661

openshift-ingress

multus

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-eb0661-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-eb0661-openshift-default-6dfb7ff98d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-eb0661-openshift-default-6dfb7ff98d

SuccessfulCreate

Created pod: e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-eb0661-9557f694b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-eb0661-9557f694b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-eb0661: serviceaccount "payload-processing-e2e-api-a-eb0661" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-eb0661-9557f694b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-eb0661

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-eb0661-9557f694b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-eb0661

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-eb0661-56654bb8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-eb0661-56654bb8c5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-eb0661-56654bb8c5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-eb0661-56654bb8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-eb0661: serviceaccount "payload-processing-e2e-api-a-eb0661" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-api-b-00d34b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-00d34b-openshift-default-5bdc5688f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-00d34b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-00d34b

openshift-ingress

replicaset-controller

e2e-api-b-00d34b-openshift-default-5bdc5688f6

SuccessfulCreate

Created pod: e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

openshift-ingress

multus

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-00d34b-54f9774875-rc782

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-00d34b: serviceaccount "payload-processing-e2e-api-b-00d34b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-00d34b-54f9774875-rc782

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-00d34b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-00d34b-54f9774875 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-00d34b-54f9774875

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-00d34b-54f9774875-rc782

openshift-ingress

multus

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-00d34b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-00d34b-5cb64f478b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-00d34b-54f9774875

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-00d34b-54f9774875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-00d34b: serviceaccount "payload-processing-e2e-api-b-00d34b" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-00d34b-54f9774875-rc782

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-00d34b-54f9774875-rc782

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-0b4d93-6749f94779-j6kqf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-0b4d93-84f9cdfdb6-p7nsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-0b4d93-openshift-default-76c65cf6bd-fvgqh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-eb0661-9557f694b-lnwp9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-eb0661-56654bb8c5-w6dmb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-00d34b-54f9774875-rc782

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-00d34b-5cb64f478b-6clwr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-09c1c1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-09c1c1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-09c1c1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-09c1c1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 59785600-e69f-4a26-90c9-705a5117fc5a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-09c1c1-79bbb4d6-cttlg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-09c1c1-5fd6d77787-7cnzv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7ab633-7c46f8dc6b-jgjpb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7ab633-68894c99c5-c8n98

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-7ab633

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-7ab633: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-7ab633": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-7ab633, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c2df5ad2-6d7f-4125-87d8-372b91b2fe64, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-7ab633-openshift-default-d68f89768-cqlmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-55130c-7c969456c4-hr8pd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-55130c-6b6fcb6dfc-wmtl7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-93a496-openshift-default-5bd968988b

SuccessfulCreate

Created pod: e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-93a496

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-93a496

openshift-ingress

deployment-controller

e2e-ipp-a-93a496-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-93a496-openshift-default-5bd968988b from 0 to 1

openshift-ingress

multus

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-93a496

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-93a496-57c7cff6f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-93a496

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-93a496-66987d7998 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-93a496-57c7cff6f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-93a496-57c7cff6f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-93a496-57c7cff6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-93a496: serviceaccount "payload-processing-e2e-ipp-a-93a496" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-93a496-66987d7998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-93a496-66987d7998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-93a496: serviceaccount "payload-processing-e2e-ipp-a-93a496" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-93a496-66987d7998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

ProbeError

Readiness probe error: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Unhealthy

Readiness probe failed: Get "http://10.132.0.83:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-86dda1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-86dda1

openshift-ingress

deployment-controller

e2e-ipp-b-86dda1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-86dda1-openshift-default-67b54b6584 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-86dda1-openshift-default-67b54b6584

SuccessfulCreate

Created pod: e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

openshift-ingress

multus

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86dda1: serviceaccount "payload-processing-e2e-ipp-b-86dda1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-86dda1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-86dda1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-86dda1-b7b48f5c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

openshift-ingress

multus

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-86dda1: serviceaccount "payload-processing-e2e-ipp-b-86dda1" not found

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

ProbeError

Readiness probe error: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Unhealthy

Readiness probe failed: Get "http://10.134.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-145e15-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-145e15-openshift-default-6c664977bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-145e15

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-145e15

openshift-ingress

multus

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-145e15

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-145e15

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-145e15: serviceaccount "payload-processing-e2e-ipp-cleanup-145e15" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-145e15: serviceaccount "payload-processing-e2e-ipp-cleanup-145e15" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-145e15-7db5cb9b9c-jw872

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-145e15-7c64b75c46-hc4gm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-145e15-openshift-default-6c664977bb-hsg9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-93a496-57c7cff6f7-7spsm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-93a496-66987d7998-6tx7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-86dda1-b7b48f5c5-h99sd

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-86dda1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-86dda1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-86dda1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-86dda1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e0476f66-ed32-4154-b23b-b87374f2150f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-86dda1-69c86d65bb-24ww6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-86dda1-openshift-default-67b54b6584-kcvr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-e5aae7-574b759d99-pr2qs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-e5aae7-7b976f6db-r7lzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-e5aae7-openshift-default-54bff96fdd-fgzgr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-6275e9-b4f654fbf-xh9cn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-6275e9-667f9b6858-5rb2v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-6275e9-openshift-default-79c5b8f78-w64l7

Killing

Stopping container istio-proxy