Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s to ip-10-0-138-157.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8 to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

Scheduled

Successfully assigned openshift-ingress/e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w to ip-10-0-131-66.ec2.internal

openshift-ingress

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8 to ip-10-0-138-157.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2 to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-q4xpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-q4xpg to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-s55z8

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-s55z8 to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl to ip-10-0-138-157.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ck6nc to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-da4d4c-57b8598845-p27v6 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz to ip-10-0-131-66.ec2.internal

openshift-ingress

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84 to ip-10-0-131-66.ec2.internal

openshift-ingress

kube-auth-proxy-5b86566b9f-kmwb2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b86566b9f-kmwb2 to ip-10-0-141-81.ec2.internal

openshift-ingress

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd to ip-10-0-131-66.ec2.internal

openshift-ingress

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq to ip-10-0-138-157.ec2.internal

openshift-ingress

router-default-54ff77667d-jgqz5

Scheduled

Successfully assigned openshift-ingress/router-default-54ff77667d-jgqz5 to ip-10-0-141-81.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4 to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2 to ip-10-0-138-157.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bnpdc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bnpdc to ip-10-0-141-81.ec2.internal

openshift-ingress

payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f to ip-10-0-131-66.ec2.internal

openshift-ingress

kube-auth-proxy-5b86566b9f-78vr6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b86566b9f-78vr6 to ip-10-0-138-157.ec2.internal

openshift-ingress

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5 to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f to ip-10-0-138-157.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-wxd54

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-wxd54 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s to ip-10-0-138-157.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2 to ip-10-0-131-66.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47 to ip-10-0-131-66.ec2.internal

openshift-ingress

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj to ip-10-0-131-66.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-54ff77667d from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-54ff77667d

FailedCreate

Error creating: pods "router-default-54ff77667d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-54ff77667d

FailedCreate

Error creating: pods "router-default-54ff77667d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-54ff77667d

SuccessfulCreate

Created pod: router-default-54ff77667d-jgqz5
(x6)

openshift-ingress

kubelet

router-default-54ff77667d-jgqz5

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-54ff77667d-jgqz5

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-54ff77667d-jgqz5

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-54ff77667d-jgqz5

Started

Started container router

openshift-ingress

kubelet

router-default-54ff77667d-jgqz5

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-54ff77667d-jgqz5

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5b86566b9f from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5b86566b9f

SuccessfulCreate

Created pod: kube-auth-proxy-5b86566b9f-kmwb2
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-5b86566b9f

FailedCreate

Error creating: pods "kube-auth-proxy-5b86566b9f-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5b86566b9f

SuccessfulCreate

Created pod: kube-auth-proxy-5b86566b9f-78vr6

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-kmwb2

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-78vr6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5b86566b9f-78vr6

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-kmwb2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5b86566b9f-kmwb2

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bnpdc

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bnpdc

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-kmwb2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.566s (2.566s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-78vr6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-kmwb2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-kmwb2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-78vr6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b86566b9f-78vr6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.208s (3.208s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.659s (3.659s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.781s (2.781s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.099s (3.099s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-87gw6

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcqqmv2

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-wxd54

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wxd54

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-wxd54

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wxd54

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wxd54

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.363s (2.363s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wxd54

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wxd54

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wxd54

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bnpdc

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bnpdc

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-ck6nc

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-q4xpg
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-s55z8

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s55z8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-s55z8

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q4xpg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-q4xpg

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q4xpg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q4xpg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-q4xpg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.11s (2.11s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s55z8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s55z8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.857s (2.857s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s55z8

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ck6nc

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-614a02-openshift-default-746865fc5d

SuccessfulCreate

Created pod: e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

openshift-ingress

gateway_labeler_controller

e2e-inf-a-614a02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-614a02

openshift-ingress

deployment-controller

e2e-inf-a-614a02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-614a02-openshift-default-746865fc5d from 0 to 1

openshift-ingress

multus

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.946s (2.946s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-614a02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-614a02-56478c7586 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-614a02-6d4f5678b9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-614a02-6d4f5678b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-614a02: serviceaccount "payload-processing-e2e-inf-a-614a02" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-614a02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-614a02-6d4f5678b9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-614a02-56478c7586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-614a02-56478c7586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-614a02: serviceaccount "payload-processing-e2e-inf-a-614a02" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-614a02-56478c7586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-614a02-6d4f5678b9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

openshift-ingress

kubelet

payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-140be7ab-openshift-default-5456659c5b

SuccessfulCreate

Created pod: e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

openshift-ingress

multus

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-140be7ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-140be7ab

openshift-ingress

deployment-controller

e2e-ait-140be7ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-140be7ab-openshift-default-5456659c5b from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-da4d4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-da4d4c-openshift-default-56bbf7684b from 0 to 1

openshift-ingress

multus

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-da4d4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-da4d4c

openshift-ingress

GatewayAuthBootstrap

e2e-autores-da4d4c

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-da4d4c-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-da4d4c-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-autores-da4d4c-openshift-default-56bbf7684b

SuccessfulCreate

Created pod: e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-140be7ab-567fff8446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-140be7ab-567fff8446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-140be7ab: serviceaccount "payload-processing-e2e-ait-140be7ab" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-140be7ab-747d4fbd47

SuccessfulCreate

Created pod: payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-140be7ab-567fff8446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-140be7ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-140be7ab-567fff8446 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-140be7ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-140be7ab-747d4fbd47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-140be7ab-747d4fbd47

FailedCreate

Error creating: pods "payload-processing-e2e-ait-140be7ab-747d4fbd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-140be7ab: serviceaccount "payload-processing-e2e-ait-140be7ab" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-da4d4c: serviceaccount "payload-processing-e2e-autores-da4d4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-da4d4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-da4d4c-57b8598845

FailedCreate

Error creating: pods "payload-processing-e2e-autores-da4d4c-57b8598845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-da4d4c: serviceaccount "payload-processing-e2e-autores-da4d4c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-da4d4c-57b8598845

SuccessfulCreate

Created pod: payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

openshift-ingress

deployment-controller

payload-processing-e2e-autores-da4d4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-da4d4c-57b8598845 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3bcf58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3bcf58

openshift-ingress

deployment-controller

e2e-inf-b-3bcf58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3bcf58-openshift-default-65b797cd94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-3bcf58-openshift-default-65b797cd94

SuccessfulCreate

Created pod: e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84
(x2)

openshift-ingress

kubelet

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3bcf58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3bcf58: serviceaccount "payload-processing-e2e-inf-b-3bcf58" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3bcf58: serviceaccount "payload-processing-e2e-inf-b-3bcf58" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3bcf58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-140be7ab-openshift-default-5456659c5b-5g5wt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-140be7ab-747d4fbd47-kc7vn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-140be7ab-567fff8446-sfq9c

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-7928b616-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7928b616-gw

openshift-ingress

replicaset-controller

e2e-migrate-7928b616-gw-openshift-default-674d8576c6

SuccessfulCreate

Created pod: e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

openshift-ingress

deployment-controller

e2e-migrate-7928b616-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7928b616-gw-openshift-default-674d8576c6 from 0 to 1

openshift-ingress

multus

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7928b616

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7928b616-686546d77d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7928b616-686546d77d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7928b616-686546d77d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7928b616-686546d77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7928b616: serviceaccount "payload-processing-e2e-migrate-7928b616" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7928b616

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7928b616-594b5f4fc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7928b616-594b5f4fc4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7928b616-594b5f4fc4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7928b616-594b5f4fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7928b616: serviceaccount "payload-processing-e2e-migrate-7928b616" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7928b616-686546d77d-8gpn7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-7928b616-gw-openshift-default-674d8576c6-z6rbm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-7928b616-594b5f4fc4-mlf6s

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-dc11d6be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-dc11d6be-openshift-default-5c9f659fb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-dc11d6be-openshift-default-5c9f659fb8

SuccessfulCreate

Created pod: e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

openshift-ingress

gateway_labeler_controller

e2e-ait-dc11d6be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-dc11d6be

openshift-ingress

multus

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-dc11d6be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dc11d6be: serviceaccount "payload-processing-e2e-ait-dc11d6be" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-dc11d6be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-dc11d6be-64b9d5f6b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-dc11d6be: serviceaccount "payload-processing-e2e-ait-dc11d6be" not found

openshift-ingress

multus

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-dc11d6be-64b9d5f6b7-8q6nh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-dc11d6be-cbd97bdfd-slpvk

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-863fd8cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-863fd8cf

openshift-ingress

kubelet

e2e-ait-dc11d6be-openshift-default-5c9f659fb8-r94rx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-863fd8cf-openshift-default-69f98f6dc6

SuccessfulCreate

Created pod: e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

openshift-ingress

deployment-controller

e2e-derive-863fd8cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-863fd8cf-openshift-default-69f98f6dc6 from 0 to 1

openshift-ingress

multus

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-863fd8cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-863fd8cf-5bf759df6f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-863fd8cf-5bf759df6f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-863fd8cf-5bf759df6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-863fd8cf: serviceaccount "payload-processing-e2e-derive-863fd8cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-863fd8cf-5bf759df6f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

openshift-ingress

kubelet

payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-863fd8cf: serviceaccount "payload-processing-e2e-derive-863fd8cf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-863fd8cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-863fd8cf-c457fb78b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-863fd8cf-openshift-default-69f98f6dc6-g7nz5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-863fd8cf-c457fb78b-dtfxr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-863fd8cf-5bf759df6f-tc59f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-da4d4c-57b8598845-p27v6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-da4d4c-f56b9c7bb-wtr9w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-da4d4c-openshift-default-56bbf7684b-vtcjj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-085b77-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-085b77-openshift-default-74dbf4bc76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-085b77

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-085b77

openshift-ingress

replicaset-controller

e2e-explicit-085b77-openshift-default-74dbf4bc76

SuccessfulCreate

Created pod: e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

openshift-ingress

multus

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-085b77

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-085b77-58bd95fff4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-085b77

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-085b77-5f8d7bb75c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-085b77-58bd95fff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-085b77-58bd95fff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-085b77: serviceaccount "payload-processing-e2e-explicit-085b77" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-085b77-5f8d7bb75c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-085b77-5f8d7bb75c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-085b77-5f8d7bb75c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-085b77: serviceaccount "payload-processing-e2e-explicit-085b77" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-085b77-58bd95fff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-085b77-5f8d7bb75c-2jfl9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-085b77-58bd95fff4-6vkwk

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-e8e5dd53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-e8e5dd53

openshift-ingress

deployment-controller

e2e-mt-e8e5dd53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-e8e5dd53-openshift-default-59f66cb69b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-e8e5dd53-openshift-default-59f66cb69b

SuccessfulCreate

Created pod: e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

openshift-ingress

multus

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

openshift-ingress

deployment-controller

payload-processing-e2e-mt-e8e5dd53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e8e5dd53: serviceaccount "payload-processing-e2e-mt-e8e5dd53" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-e8e5dd53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-e8e5dd53: serviceaccount "payload-processing-e2e-mt-e8e5dd53" not found

openshift-ingress

multus

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4

SuccessfulCreate

Created pod: e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

openshift-ingress

kubelet

e2e-explicit-085b77-openshift-default-74dbf4bc76-ncmdq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-b0d2d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-b0d2d0

openshift-ingress

deployment-controller

e2e-noten-b0d2d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-b0d2d0-openshift-default-54cd7ff9d4 from 0 to 1

openshift-ingress

kubelet

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-b0d2d0-openshift-default-54cd7ff9d4-s79jt

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-e8e5dd53

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-e8e5dd53: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-e8e5dd53": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-e8e5dd53, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d0a5158e-20c1-4167-8ce3-f91e647b7541, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-e8e5dd53-7d999d4c58-rvb9l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-e8e5dd53-5b7c4b84cc-25q8d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-e8e5dd53-openshift-default-59f66cb69b-bkggn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-614a02-56478c7586-jqjz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-614a02-6d4f5678b9-42c2f

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-263421

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-263421

openshift-ingress

kubelet

e2e-inf-a-614a02-openshift-default-746865fc5d-gg2h4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-263421-openshift-default-75f6dbc846

SuccessfulCreate

Created pod: e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

openshift-ingress

deployment-controller

e2e-shared-a-w2-263421-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-263421-openshift-default-75f6dbc846 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-263421-6fb5b448df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-263421-6fb5b448df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-263421-6fb5b448df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-263421: serviceaccount "payload-processing-e2e-shared-a-w2-263421" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-263421

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-263421-6fb5b448df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-263421: serviceaccount "payload-processing-e2e-shared-a-w2-263421" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-263421

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3bcf58-7dbb55574b-xhkl8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3bcf58-6b9b8b69f7-rxqtk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-3dc031

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-3dc031

openshift-ingress

deployment-controller

e2e-shared-a-w3-3dc031-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-3dc031-openshift-default-5788d65768 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-3dc031-openshift-default-5788d65768

SuccessfulCreate

Created pod: e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

openshift-ingress

multus

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-3dc031: serviceaccount "payload-processing-e2e-shared-a-w3-3dc031" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-3dc031

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-3dc031

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-3dc031: serviceaccount "payload-processing-e2e-shared-a-w3-3dc031" not found

openshift-ingress

kubelet

e2e-inf-b-3bcf58-openshift-default-65b797cd94-w5w84

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-5560ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5560ef-openshift-default-7765894878 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5560ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5560ef

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5560ef-openshift-default-7765894878

SuccessfulCreate

Created pod: e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

openshift-ingress

multus

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5560ef: serviceaccount "payload-processing-e2e-shared-b-w2-5560ef" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5560ef: serviceaccount "payload-processing-e2e-shared-b-w2-5560ef" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5560ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5560ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-34de95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-34de95

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": read tcp 10.133.0.2:43590->10.133.0.65:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": read tcp 10.133.0.2:43590->10.133.0.65:15021: read: connection reset by peer body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-34de95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b

SuccessfulCreate

Created pod: e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-34de95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-34de95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-34de95-66956cbb4f from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-34de95: serviceaccount "payload-processing-e2e-shared-b-w3-34de95" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-34de95: serviceaccount "payload-processing-e2e-shared-b-w3-34de95" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-12fc0fc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-12fc0fc8-openshift-default-95dd555fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-12fc0fc8-openshift-default-95dd555fb

SuccessfulCreate

Created pod: e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

openshift-ingress

gateway_labeler_controller

e2e-mt-12fc0fc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-12fc0fc8
(x2)

openshift-ingress

GatewayAuthBootstrap

e2e-mt-12fc0fc8

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-12fc0fc8-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-12fc0fc8-authn-ssl" already exists

openshift-ingress

multus

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-12fc0fc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-12fc0fc8-6d9896846f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-12fc0fc8: serviceaccount "payload-processing-e2e-mt-12fc0fc8" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-12fc0fc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-12fc0fc8-6d9896846f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-12fc0fc8-6d9896846f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-12fc0fc8: serviceaccount "payload-processing-e2e-mt-12fc0fc8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-12fc0fc8-6d9896846f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-12fc0fc8-5869689bcd-6s4st

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-12fc0fc8-6d9896846f-7x5n2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-12fc0fc8-openshift-default-95dd555fb-z5b8w

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-ce194a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ce194a-openshift-default-7bd484597d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-ce194a-openshift-default-7bd484597d

SuccessfulCreate

Created pod: e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

openshift-ingress

gateway_labeler_controller

e2e-api-a-ce194a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ce194a

openshift-ingress

multus

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ce194a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ce194a-5c4f8f645 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ce194a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ce194a-7d5c68c746 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ce194a-5c4f8f645

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ce194a-5c4f8f645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ce194a: serviceaccount "payload-processing-e2e-api-a-ce194a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ce194a: serviceaccount "payload-processing-e2e-api-a-ce194a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ce194a-5c4f8f645

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-558343-openshift-default-57c7d5465d

SuccessfulCreate

Created pod: e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

openshift-ingress

gateway_labeler_controller

e2e-api-b-558343

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-558343

openshift-ingress

deployment-controller

e2e-api-b-558343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-558343-openshift-default-57c7d5465d from 0 to 1

openshift-ingress

multus

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-558343

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-558343-7c4dbf44cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-558343

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-558343-68d6f4c869 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-558343-68d6f4c869

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-558343-68d6f4c869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-558343: serviceaccount "payload-processing-e2e-api-b-558343" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-558343-68d6f4c869

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-558343: serviceaccount "payload-processing-e2e-api-b-558343" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce194a-5c4f8f645-lsl9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce194a-7d5c68c746-pxd49

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ce194a-openshift-default-7bd484597d-cslhd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-558343-68d6f4c869-4lnw8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-558343-7c4dbf44cd-qldd8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-558343-openshift-default-57c7d5465d-c5tg8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-263421-86b74bf6b6-55tdv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-263421-6fb5b448df-zz86j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-263421-openshift-default-75f6dbc846-h4cl2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5560ef-5dcd675d9c-k97rl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5560ef-67bb85546-vmdsw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-5560ef-openshift-default-7765894878-brmqz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd

SuccessfulCreate

Created pod: e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

openshift-ingress

deployment-controller

e2e-ipp-a-0a9a72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0a9a72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0a9a72

openshift-ingress

multus

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0a9a72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0a9a72: serviceaccount "payload-processing-e2e-ipp-a-0a9a72" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0a9a72: serviceaccount "payload-processing-e2e-ipp-a-0a9a72" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0a9a72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-da0a32-openshift-default-58c6cfb886

SuccessfulCreate

Created pod: e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-da0a32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-da0a32

openshift-ingress

deployment-controller

e2e-ipp-b-da0a32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-da0a32-openshift-default-58c6cfb886 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-da0a32-69fb97f44f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-da0a32: serviceaccount "payload-processing-e2e-ipp-b-da0a32" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-da0a32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-da0a32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-da0a32-69fb97f44f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-da0a32-69fb97f44f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-da0a32-69fb97f44f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-da0a32: serviceaccount "payload-processing-e2e-ipp-b-da0a32" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": read tcp 10.134.0.2:60178->10.134.0.82:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": read tcp 10.134.0.2:60178->10.134.0.82:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d9283c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d9283c

openshift-ingress

multus

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d9283c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d9283c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d9283c: serviceaccount "payload-processing-e2e-ipp-cleanup-d9283c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d9283c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d9283c: serviceaccount "payload-processing-e2e-ipp-cleanup-d9283c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d9283c-7df57bbff7-gh8r2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d9283c-844466cd54-5mtpw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-d9283c-openshift-default-6cccfb8b6b-8cpsw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0a9a72-85bf4dd6b9-vk44r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0a9a72-5c9677c56b-jn5gn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-0a9a72-openshift-default-7dcb79c6fd-zs7fl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-da0a32-69fb97f44f-lkj47

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-da0a32

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-da0a32: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-da0a32": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-da0a32, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c51bc2b6-8a57-4e08-8abe-551418611907, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-da0a32-69588f7dfd-wv2t2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-da0a32-openshift-default-58c6cfb886-47c2s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3dc031-845b688f5d-bdvc5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3dc031-7d96fb7495-lnhnq

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-3dc031

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3dc031: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-3dc031": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3dc031, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2f84fca5-6bb9-43e1-b2fb-fa7fc76c6425, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-3dc031-openshift-default-5788d65768-pmvxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-34de95-66956cbb4f-nxgb4

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-34de95

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-34de95: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-34de95": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-34de95, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 907ecb9f-4aed-4200-b0dd-60355f8bde5f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-34de95-7454d4d794-t8t78

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-34de95-openshift-default-7c6cf84f8b-fqcvc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503