Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-86748cc5bf-frg7j

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86748cc5bf-frg7j to ip-10-0-139-129.ec2.internal

openshift-ingress

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6 to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m to ip-10-0-141-105.ec2.internal

openshift-ingress

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz to ip-10-0-139-129.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2 to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7 to ip-10-0-141-105.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-5zqtx to ip-10-0-139-129.ec2.internal

openshift-ingress

e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

Scheduled

Successfully assigned openshift-ingress/e2e-noten-96c7d4-openshift-default-785b65d79d-j8777 to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq to ip-10-0-139-129.ec2.internal

openshift-ingress

payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-89230689-openshift-default-554676cc96-nf7hw to ip-10-0-139-129.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-69ccr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-69ccr to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2 to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22 to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-89230689-86546466-74csh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-89230689-86546466-74csh to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6 to ip-10-0-141-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-8kfvp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-8kfvp to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-459a4c-66448b8677-b7c55

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-459a4c-66448b8677-b7c55 to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk to ip-10-0-141-105.ec2.internal

openshift-ingress

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm to ip-10-0-138-121.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-j6bll

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j6bll to ip-10-0-139-129.ec2.internal

openshift-ingress

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8 to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-k796r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-k796r to ip-10-0-139-129.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2 to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-49518b-openshift-default-66665585bb-22mjv to ip-10-0-139-129.ec2.internal

openshift-ingress

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-459a4c-openshift-default-977b8764d-bsptj to ip-10-0-138-121.ec2.internal

openshift-ingress

kube-auth-proxy-86748cc5bf-kcpw8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86748cc5bf-kcpw8 to ip-10-0-141-105.ec2.internal

openshift-ingress

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v to ip-10-0-139-129.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8 to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Scheduled

Successfully assigned openshift-ingress/e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226 to ip-10-0-139-129.ec2.internal

openshift-ingress

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t to ip-10-0-141-105.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cmhct8 to ip-10-0-139-129.ec2.internal

openshift-ingress

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g to ip-10-0-138-121.ec2.internal

openshift-ingress

router-default-7ff5fb48d-7h989

Scheduled

Successfully assigned openshift-ingress/router-default-7ff5fb48d-7h989 to ip-10-0-141-105.ec2.internal

openshift-ingress

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-mt-89230689-867f69445c-g7p8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-89230689-867f69445c-g7p8s to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr to ip-10-0-141-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Scheduled

Successfully assigned openshift-ingress/e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48 to ip-10-0-141-105.ec2.internal

openshift-ingress

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv to ip-10-0-138-121.ec2.internal

openshift-ingress

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm to ip-10-0-139-129.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8 to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt to ip-10-0-138-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh to ip-10-0-138-121.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7ff5fb48d from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-7ff5fb48d

FailedCreate

Error creating: pods "router-default-7ff5fb48d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7ff5fb48d

FailedCreate

Error creating: pods "router-default-7ff5fb48d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7ff5fb48d

SuccessfulCreate

Created pod: router-default-7ff5fb48d-7h989
(x6)

openshift-ingress

kubelet

router-default-7ff5fb48d-7h989

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7ff5fb48d-7h989

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-7ff5fb48d-7h989

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7ff5fb48d-7h989

Started

Started container router

openshift-ingress

kubelet

router-default-7ff5fb48d-7h989

Created

Created container: router

openshift-ingress

kubelet

router-default-7ff5fb48d-7h989

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-kcpw8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-86748cc5bf

FailedCreate

Error creating: pods "kube-auth-proxy-86748cc5bf-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-86748cc5bf-kcpw8

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-86748cc5bf-frg7j

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-86748cc5bf from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-86748cc5bf

SuccessfulCreate

Created pod: kube-auth-proxy-86748cc5bf-kcpw8

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-frg7j

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-86748cc5bf

SuccessfulCreate

Created pod: kube-auth-proxy-86748cc5bf-frg7j

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-j6bll

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-j6bll

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-kcpw8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-kcpw8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-kcpw8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.784s (2.784s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-frg7j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.688s (6.688s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-frg7j

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.556s (5.556s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86748cc5bf-frg7j

Created

Created container: kube-auth-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-8kfvp

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8kfvp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-8kfvp

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8kfvp

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8kfvp

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8kfvp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.253s (2.253s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.82s (2.82s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-j6bll

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

Unhealthy

Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cmhct8

ProbeError

Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-j6bll

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-5zqtx

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-k796r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-69ccr

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k796r

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-k796r

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69ccr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-69ccr

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k796r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k796r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k796r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.127s (2.127s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69ccr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.339s (2.339s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69ccr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-69ccr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-5zqtx

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-4c62f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-4c62f1

openshift-ingress

replicaset-controller

e2e-inf-a-4c62f1-openshift-default-d78d776b

SuccessfulCreate

Created pod: e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

openshift-ingress

deployment-controller

e2e-inf-a-4c62f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-4c62f1-openshift-default-d78d776b from 0 to 1

openshift-ingress

multus

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-4c62f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-4c62f1-8468fc7f57 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4c62f1: serviceaccount "payload-processing-e2e-inf-a-4c62f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4c62f1-8468fc7f57

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-4c62f1-8468fc7f57

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-4c62f1-8468fc7f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-4c62f1: serviceaccount "payload-processing-e2e-inf-a-4c62f1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-4c62f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-4c62f1-6894c46554 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.729s (1.729s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-fd0def

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-fd0def

openshift-ingress

multus

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-1eeb81b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1eeb81b2

openshift-ingress

deployment-controller

e2e-ait-1eeb81b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1eeb81b2-openshift-default-d68fd5764 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1eeb81b2-openshift-default-d68fd5764

SuccessfulCreate

Created pod: e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

openshift-ingress

deployment-controller

e2e-autores-fd0def-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-fd0def-openshift-default-6d8dfd864d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-fd0def-openshift-default-6d8dfd864d

SuccessfulCreate

Created pod: e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

openshift-ingress

multus

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.62s (2.62s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1eeb81b2-798bd466f5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1eeb81b2-798bd466f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1eeb81b2: serviceaccount "payload-processing-e2e-ait-1eeb81b2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1eeb81b2: serviceaccount "payload-processing-e2e-ait-1eeb81b2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1eeb81b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1eeb81b2-798bd466f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1eeb81b2-798bd466f5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1eeb81b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-8efac4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-8efac4-openshift-default-66557bb4f8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-8efac4

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-8efac4-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-8efac4-authn-ssl" already exists
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-fd0def-bb56f6895

FailedCreate

Error creating: pods "payload-processing-e2e-autores-fd0def-bb56f6895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-fd0def: serviceaccount "payload-processing-e2e-autores-fd0def" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-fd0def-bb56f6895

SuccessfulCreate

Created pod: payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

payload-processing-e2e-autores-fd0def

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-fd0def-bb56f6895 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-8efac4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-8efac4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-fd0def-5d59887bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-fd0def-5d59887bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-fd0def: serviceaccount "payload-processing-e2e-autores-fd0def" not found

openshift-ingress

replicaset-controller

e2e-inf-b-8efac4-openshift-default-66557bb4f8

SuccessfulCreate

Created pod: e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

openshift-ingress

multus

payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-fd0def

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-fd0def-5d59887bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-fd0def-5d59887bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

openshift-ingress

kubelet

payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.58s (2.58s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

ProbeError

Readiness probe error: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Unhealthy

Readiness probe failed: Get "http://10.132.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8efac4: serviceaccount "payload-processing-e2e-inf-b-8efac4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8efac4-68b56cd9d9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-8efac4-68b56cd9d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-8efac4: serviceaccount "payload-processing-e2e-inf-b-8efac4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-8efac4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-8efac4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-8efac4-68b56cd9d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-8efac4-68b56cd9d9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1eeb81b2-56c595b47d-v9cgk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1eeb81b2-798bd466f5-vxnm2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-1eeb81b2-openshift-default-d68fd5764-7hwtq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-2c6bf060-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2c6bf060-gw

openshift-ingress

deployment-controller

e2e-migrate-2c6bf060-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d

SuccessfulCreate

Created pod: e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

openshift-ingress

multus

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2c6bf060

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2c6bf060

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2c6bf060-844699d46b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

openshift-ingress

kubelet

payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2c6bf060-844699d46b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2c6bf060-844699d46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2c6bf060: serviceaccount "payload-processing-e2e-migrate-2c6bf060" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2c6bf060-844699d46b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

openshift-ingress

kubelet

payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2c6bf060: serviceaccount "payload-processing-e2e-migrate-2c6bf060" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-2c6bf060-844699d46b-nzdk8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-2c6bf060

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-2c6bf060: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-2c6bf060": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-2c6bf060, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bdbcd4b1-31f1-47fd-a44d-c162e4a442ff, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2c6bf060-c5c9797d6-pctzf

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-b65989d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b65989d0

openshift-ingress

deployment-controller

e2e-ait-b65989d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b65989d0-openshift-default-7bcbd59bb6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b65989d0-openshift-default-7bcbd59bb6

SuccessfulCreate

Created pod: e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

openshift-ingress

kubelet

e2e-migrate-2c6bf060-gw-openshift-default-684bf7746d-b5czv

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b65989d0-6f5f5b8565

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b65989d0-6f5f5b8565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b65989d0: serviceaccount "payload-processing-e2e-ait-b65989d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b65989d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b65989d0-6f5f5b8565 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b65989d0-6f5f5b8565

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b65989d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b65989d0: serviceaccount "payload-processing-e2e-ait-b65989d0" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-b65989d0-6f5f5b8565-wzfkq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b65989d0-65d7f8f6f8-z7bgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b65989d0-openshift-default-7bcbd59bb6-78l9k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-4ce893dc-openshift-default-59496b9896

SuccessfulCreate

Created pod: e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

openshift-ingress

gateway_labeler_controller

e2e-derive-4ce893dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-4ce893dc

openshift-ingress

deployment-controller

e2e-derive-4ce893dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-4ce893dc-openshift-default-59496b9896 from 0 to 1

openshift-ingress

multus

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-4ce893dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-4ce893dc-5458888db5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4ce893dc-5458888db5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-4ce893dc-5458888db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4ce893dc: serviceaccount "payload-processing-e2e-derive-4ce893dc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-4ce893dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-4ce893dc-5cb6566566 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-4ce893dc-5458888db5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

openshift-ingress

multus

payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-4ce893dc: serviceaccount "payload-processing-e2e-derive-4ce893dc" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fd0def-5d59887bb-xb8gk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-fd0def-bb56f6895-nn5m7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-4ce893dc-5cb6566566-vwnql

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-4ce893dc-openshift-default-59496b9896-zt44l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-4ce893dc-5458888db5-q24xq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-fd0def-openshift-default-6d8dfd864d-wjm48

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-459a4c-openshift-default-977b8764d

SuccessfulCreate

Created pod: e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

openshift-ingress

multus

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-459a4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-459a4c

openshift-ingress

deployment-controller

e2e-explicit-459a4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-459a4c-openshift-default-977b8764d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-459a4c-66448b8677

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-459a4c-66448b8677-b7c55
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-459a4c: serviceaccount "payload-processing-e2e-explicit-459a4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-459a4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-459a4c-f97c9d9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-459a4c-66448b8677

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-459a4c-66448b8677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-459a4c: serviceaccount "payload-processing-e2e-explicit-459a4c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-459a4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-459a4c-66448b8677 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-459a4c-66448b8677-b7c55

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-459a4c-66448b8677-b7c55

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-459a4c-66448b8677-b7c55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-459a4c-66448b8677-b7c55

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-459a4c-66448b8677-b7c55

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-459a4c-f97c9d9d-24nbj

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-noten-96c7d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-96c7d4

openshift-ingress

kubelet

e2e-explicit-459a4c-openshift-default-977b8764d-bsptj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-96c7d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-96c7d4-openshift-default-785b65d79d from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-96c7d4-openshift-default-785b65d79d

SuccessfulCreate

Created pod: e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

openshift-ingress

kubelet

e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-4c62f1-8468fc7f57-x72s8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

Unhealthy

Readiness probe failed: dial tcp 10.134.0.37:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-4c62f1-6894c46554-w4b22

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-mt-4f6c0189-openshift-default-7cd8f458d4

SuccessfulCreate

Created pod: e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

openshift-ingress

deployment-controller

e2e-mt-4f6c0189-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4f6c0189-openshift-default-7cd8f458d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-4f6c0189

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4f6c0189

openshift-ingress

multus

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4f6c0189-65b88f8bc7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4f6c0189-65b88f8bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4f6c0189: serviceaccount "payload-processing-e2e-mt-4f6c0189" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4f6c0189

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4f6c0189-5857d987bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4f6c0189: serviceaccount "payload-processing-e2e-mt-4f6c0189" not found

openshift-ingress

kubelet

e2e-inf-a-4c62f1-openshift-default-d78d776b-ql226

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4f6c0189-65b88f8bc7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4f6c0189

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4f6c0189-65b88f8bc7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-8efac4-68b56cd9d9-5vx4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-8efac4-5df6f86d78-8xm9m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-8efac4-openshift-default-66557bb4f8-dl5z8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-b4d3cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-b4d3cf

openshift-ingress

replicaset-controller

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb

SuccessfulCreate

Created pod: e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

openshift-ingress

deployment-controller

e2e-shared-a-w3-b4d3cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b4d3cf: serviceaccount "payload-processing-e2e-shared-a-w3-b4d3cf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-b4d3cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b4d3cf: serviceaccount "payload-processing-e2e-shared-a-w3-b4d3cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-b4d3cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-4f6c0189

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-4f6c0189: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-4f6c0189": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-4f6c0189, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 65303bf9-4ce4-4939-8cc7-b5ea19c7a073, UID in object meta:

openshift-ingress

endpoint-controller

payload-processing-e2e-mt-4f6c0189

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-mt-4f6c0189: Operation cannot be fulfilled on endpoints "payload-processing-e2e-mt-4f6c0189": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-mt-4f6c0189, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dfdec9ba-1e6e-440e-8828-c5ac4ab22559, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-4f6c0189-65b88f8bc7-8h9gz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4f6c0189-5857d987bb-5sjm6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:34890->10.132.0.59:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-4f6c0189-openshift-default-7cd8f458d4-jswgm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": read tcp 10.132.0.2:34890->10.132.0.59:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d

SuccessfulCreate

Created pod: e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

openshift-ingress

deployment-controller

e2e-shared-b-w3-dd5b30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-dd5b30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-dd5b30
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-dd5b30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-dd5b30: serviceaccount "payload-processing-e2e-shared-b-w3-dd5b30" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-dd5b30: serviceaccount "payload-processing-e2e-shared-b-w3-dd5b30" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-dd5b30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-96c7d4-openshift-default-785b65d79d-j8777

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-20ae9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-20ae9a

openshift-ingress

replicaset-controller

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d

SuccessfulCreate

Created pod: e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

openshift-ingress

deployment-controller

e2e-shared-a-w2-20ae9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:56092->10.134.0.64:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-20ae9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-20ae9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549 from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:56092->10.134.0.64:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-20ae9a: serviceaccount "payload-processing-e2e-shared-a-w2-20ae9a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-20ae9a: serviceaccount "payload-processing-e2e-shared-a-w2-20ae9a" not found
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7dc787

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7dc787

openshift-ingress

deployment-controller

e2e-shared-b-w2-7dc787-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7dc787-openshift-default-78765f97b from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7dc787-openshift-default-78765f97b

SuccessfulCreate

Created pod: e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

openshift-ingress

multus

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7dc787: serviceaccount "payload-processing-e2e-shared-b-w2-7dc787" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7dc787

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7dc787-744d659f5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7dc787-744d659f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7dc787

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7dc787-744d659f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7dc787-744d659f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7dc787: serviceaccount "payload-processing-e2e-shared-b-w2-7dc787" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-89230689-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-89230689-openshift-default-554676cc96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-89230689-openshift-default-554676cc96

SuccessfulCreate

Created pod: e2e-mt-89230689-openshift-default-554676cc96-nf7hw

openshift-ingress

gateway_labeler_controller

e2e-mt-89230689

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-89230689

openshift-ingress

multus

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-89230689

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-89230689-867f69445c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-89230689

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-89230689-86546466 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-89230689-86546466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-89230689-86546466-74csh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-89230689-86546466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-89230689-86546466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-89230689: serviceaccount "payload-processing-e2e-mt-89230689" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-89230689-867f69445c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-89230689-867f69445c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-89230689: serviceaccount "payload-processing-e2e-mt-89230689" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-89230689-867f69445c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-89230689-867f69445c-g7p8s

openshift-ingress

kubelet

payload-processing-e2e-mt-89230689-867f69445c-g7p8s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89230689-867f69445c-g7p8s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-89230689-867f69445c-g7p8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-89230689-86546466-74csh

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89230689-86546466-74csh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89230689-86546466-74csh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-89230689-867f69445c-g7p8s

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89230689-86546466-74csh

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-89230689-867f69445c-g7p8s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-89230689-86546466-74csh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-89230689-openshift-default-554676cc96-nf7hw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-49518b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-49518b

openshift-ingress

deployment-controller

e2e-api-a-49518b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-49518b-openshift-default-66665585bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-49518b-openshift-default-66665585bb

SuccessfulCreate

Created pod: e2e-api-a-49518b-openshift-default-66665585bb-22mjv

openshift-ingress

multus

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-49518b-778b56d9b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-49518b-778b56d9b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-49518b-778b56d9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-49518b: serviceaccount "payload-processing-e2e-api-a-49518b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-49518b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-49518b-778b56d9b6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-49518b-6dcd48549c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-49518b-6dcd48549c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-49518b: serviceaccount "payload-processing-e2e-api-a-49518b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-49518b-6dcd48549c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-49518b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-49518b-6dcd48549c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-b61c46

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b61c46

openshift-ingress

deployment-controller

e2e-api-b-b61c46-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b61c46-openshift-default-7f74cd5f58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-b61c46-openshift-default-7f74cd5f58

SuccessfulCreate

Created pod: e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

openshift-ingress

multus

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b61c46-d5d4b49bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b61c46-d5d4b49bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b61c46-d5d4b49bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b61c46: serviceaccount "payload-processing-e2e-api-b-b61c46" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b61c46

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b61c46

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b61c46-d5d4b49bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b61c46: serviceaccount "payload-processing-e2e-api-b-b61c46" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-49518b-778b56d9b6-w5snt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-49518b-6dcd48549c-vp88r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-49518b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-49518b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-49518b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-49518b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b846fbf7-338a-42e2-bc62-ffab5d40a353, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-49518b-openshift-default-66665585bb-22mjv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-api-b-b61c46-d5d4b49bf-dpb5m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b61c46-5c9c66b79d-l9qzp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-b61c46-openshift-default-7f74cd5f58-5fl2g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-20ae9a-5ff4665549-ln6wx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-20ae9a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20ae9a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-20ae9a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-20ae9a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7f394186-52b1-4409-b3cc-c0b4a8edddbb, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-20ae9a-87496ffbb-pf2hj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-20ae9a-openshift-default-7655ccfc9d-gnqnz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7dc787-d9778787d-k5mkc

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-7dc787

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7dc787: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-7dc787": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7dc787, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cad4f4ae-9cb8-48d7-84c3-1aa2412d7956, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7dc787-744d659f5-vv99b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7dc787-openshift-default-78765f97b-vhwr6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-4cb558

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-4cb558

openshift-ingress

replicaset-controller

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8

SuccessfulCreate

Created pod: e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

openshift-ingress

multus

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-4cb558-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-4cb558-openshift-default-5d8d687dd8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4cb558-6d89c46799

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4cb558: serviceaccount "payload-processing-e2e-ipp-a-4cb558" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-4cb558

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-4cb558-6d89c46799

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-4cb558-6d89c46799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-4cb558: serviceaccount "payload-processing-e2e-ipp-a-4cb558" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-4cb558

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-4cb558-6d89c46799 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0f85b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0f85b8

openshift-ingress

replicaset-controller

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4

SuccessfulCreate

Created pod: e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

openshift-ingress

deployment-controller

e2e-ipp-b-0f85b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0f85b8-openshift-default-7d957b55c4 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0f85b8: serviceaccount "payload-processing-e2e-ipp-b-0f85b8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0f85b8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0f85b8-88497b898 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0f85b8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0f85b8-6cd9479485 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0f85b8-6cd9479485

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0f85b8-6cd9479485

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0f85b8-6cd9479485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0f85b8: serviceaccount "payload-processing-e2e-ipp-b-0f85b8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-ebb9b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-ebb9b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-ebb9b5

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46

SuccessfulCreate

Created pod: e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

openshift-ingress

multus

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-ebb9b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ebb9b5: serviceaccount "payload-processing-e2e-ipp-cleanup-ebb9b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-ebb9b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ebb9b5: serviceaccount "payload-processing-e2e-ipp-cleanup-ebb9b5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-ebb9b5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebb9b5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-ebb9b5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ebb9b5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 19f94072-dca4-4fa3-8e4c-14ded2dd2125, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ebb9b5-5cd7b7c997-6j6wt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ebb9b5-67768c486b-mg5zc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-ebb9b5-openshift-default-67b599f46-g2j6g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-4cb558-6d89c46799-s6l4v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-4cb558-6fcbd7474b-crdl2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-4cb558-openshift-default-5d8d687dd8-84f6v

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0f85b8-6cd9479485-9nzzd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0f85b8-88497b898-lq6rr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-0f85b8-openshift-default-7d957b55c4-pskrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b4d3cf-5bf969dcf-ggj5v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b4d3cf-559484c998-cq9hg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b4d3cf-openshift-default-5474ff79fb-vcdlm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-dd5b30-685f9c74fc-4dnsz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-dd5b30-59cd644494-hqhn2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-dd5b30-openshift-default-86dfc4597d-b7w6c

Killing

Stopping container istio-proxy