Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j to ip-10-0-132-81.ec2.internal

openshift-ingress

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6 to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg to ip-10-0-129-158.ec2.internal

openshift-ingress

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-dtxcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-dtxcn to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484 to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t to ip-10-0-129-158.ec2.internal

openshift-ingress

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd to ip-10-0-129-158.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-lk9v4 to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672 to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp to ip-10-0-132-81.ec2.internal

openshift-ingress

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf to ip-10-0-129-158.ec2.internal

openshift-ingress

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2 to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk to ip-10-0-129-158.ec2.internal

openshift-ingress

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Scheduled

Successfully assigned openshift-ingress/e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s to ip-10-0-129-158.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9 to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l to ip-10-0-129-158.ec2.internal

openshift-ingress

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9 to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7 to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l to ip-10-0-130-163.ec2.internal

openshift-ingress

router-default-997fdcdb-82rfx

Scheduled

Successfully assigned openshift-ingress/router-default-997fdcdb-82rfx to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8 to ip-10-0-132-81.ec2.internal

openshift-ingress

kube-auth-proxy-66d75c69df-zhqld

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66d75c69df-zhqld to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw to ip-10-0-129-158.ec2.internal

openshift-ingress

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl to ip-10-0-132-81.ec2.internal

openshift-ingress

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

Scheduled

Successfully assigned openshift-ingress/e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g to ip-10-0-130-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk to ip-10-0-129-158.ec2.internal

openshift-ingress

kube-auth-proxy-66d75c69df-wz6ps

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66d75c69df-wz6ps to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd to ip-10-0-132-81.ec2.internal

openshift-ingress

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22 to ip-10-0-132-81.ec2.internal

openshift-ingress

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-079b38-openshift-default-778d985f94-q6949 to ip-10-0-130-163.ec2.internal

openshift-ingress

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4 to ip-10-0-129-158.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-gq57h

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-gq57h to ip-10-0-132-81.ec2.internal

openshift-ingress

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Scheduled

Successfully assigned openshift-ingress/e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94 to ip-10-0-129-158.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-nc6v5

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-nc6v5 to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-767170-69d8449c69-b7grq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-767170-69d8449c69-b7grq to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db to ip-10-0-132-81.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm to ip-10-0-130-163.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-z7chl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z7chl to ip-10-0-130-163.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-997fdcdb from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-997fdcdb

FailedCreate

Error creating: pods "router-default-997fdcdb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-997fdcdb

FailedCreate

Error creating: pods "router-default-997fdcdb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-997fdcdb

SuccessfulCreate

Created pod: router-default-997fdcdb-82rfx
(x6)

openshift-ingress

kubelet

router-default-997fdcdb-82rfx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-997fdcdb-82rfx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-997fdcdb-82rfx

Started

Started container router

openshift-ingress

kubelet

router-default-997fdcdb-82rfx

Created

Created container: router

openshift-ingress

kubelet

router-default-997fdcdb-82rfx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-997fdcdb-82rfx

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-66d75c69df from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-66d75c69df

SuccessfulCreate

Created pod: kube-auth-proxy-66d75c69df-wz6ps

openshift-ingress

replicaset-controller

kube-auth-proxy-66d75c69df

SuccessfulCreate

Created pod: kube-auth-proxy-66d75c69df-zhqld
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-66d75c69df

FailedCreate

Error creating: pods "kube-auth-proxy-66d75c69df-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-66d75c69df-wz6ps

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-zhqld

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-66d75c69df-zhqld

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-wz6ps

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-z7chl

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-z7chl

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-zhqld

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-wz6ps

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.704s (2.704s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-wz6ps

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-wz6ps

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-zhqld

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.756s (2.756s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-66d75c69df-zhqld

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.637s (2.637s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Created

Created container: discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwmmzm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.395s (3.395s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-gq57h

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gq57h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-gq57h

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gq57h

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gq57h

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gq57h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.401s (2.401s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-z7chl

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

ProbeError

Readiness probe error: Get "http://10.134.0.19:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z7chl

Unhealthy

Readiness probe failed: Get "http://10.134.0.19:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-lk9v4

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.825s (2.825s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-nc6v5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-dtxcn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-nc6v5

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-nc6v5

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dtxcn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-dtxcn

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-nc6v5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dtxcn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dtxcn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.121s (2.122s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dtxcn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-nc6v5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-nc6v5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.799s (2.799s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-lk9v4

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-96cfc6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-96cfc6-openshift-default-557b7b668d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-d9b17d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-d9b17d

openshift-ingress

replicaset-controller

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd

SuccessfulCreate

Created pod: e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

openshift-ingress

replicaset-controller

e2e-inf-a-96cfc6-openshift-default-557b7b668d

SuccessfulCreate

Created pod: e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-079b38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-079b38

openshift-ingress

deployment-controller

e2e-worker-w4-079b38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-079b38-openshift-default-778d985f94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-079b38-openshift-default-778d985f94

SuccessfulCreate

Created pod: e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

openshift-ingress

gateway_labeler_controller

e2e-inf-a-96cfc6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-96cfc6

openshift-ingress

deployment-controller

e2e-worker-w0-d9b17d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd from 0 to 1

openshift-ingress

multus

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-079b38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-079b38-6f96f9498 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-079b38: serviceaccount "payload-processing-e2e-worker-w4-079b38" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-079b38: serviceaccount "payload-processing-e2e-worker-w4-079b38" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-079b38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-079b38-5d8f46b7bf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-d9b17d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-d9b17d-5467978d5c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d9b17d: serviceaccount "payload-processing-e2e-worker-w0-d9b17d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d9b17d-5467978d5c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-d9b17d-5467978d5c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-d9b17d-5467978d5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-d9b17d: serviceaccount "payload-processing-e2e-worker-w0-d9b17d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-d9b17d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-96cfc6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-96cfc6-69bd59fcf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-96cfc6-69bd59fcf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-96cfc6-69bd59fcf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-96cfc6-69bd59fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-96cfc6: serviceaccount "payload-processing-e2e-inf-a-96cfc6" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-96cfc6: serviceaccount "payload-processing-e2e-inf-a-96cfc6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-96cfc6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.853s (1.853s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-0458f0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-0458f0

openshift-ingress

deployment-controller

e2e-autores-0458f0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-0458f0-openshift-default-7b89fd88bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-0458f0-openshift-default-7b89fd88bd

SuccessfulCreate

Created pod: e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-1ee55ce9-openshift-default-774686748d

SuccessfulCreate

Created pod: e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

openshift-ingress

deployment-controller

e2e-ait-1ee55ce9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1ee55ce9-openshift-default-774686748d from 0 to 1

openshift-ingress

multus

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-1ee55ce9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1ee55ce9

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.788s (3.788s including waiting). Image size: 166449312 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1ee55ce9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1ee55ce9-66956858c5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1ee55ce9: serviceaccount "payload-processing-e2e-ait-1ee55ce9" not found

openshift-ingress

multus

payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1ee55ce9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1ee55ce9-66956858c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1ee55ce9-66956858c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1ee55ce9-66956858c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1ee55ce9: serviceaccount "payload-processing-e2e-ait-1ee55ce9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

openshift-ingress

kubelet

payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-0458f0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-0458f0-6486b5497f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-0458f0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-0458f0-5b596df974 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0458f0-5b596df974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-0458f0-5b596df974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0458f0: serviceaccount "payload-processing-e2e-autores-0458f0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0458f0-5b596df974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

openshift-ingress

kubelet

payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0458f0-6486b5497f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-0458f0-6486b5497f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0458f0: serviceaccount "payload-processing-e2e-autores-0458f0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0458f0-6486b5497f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

openshift-ingress

multus

payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fe6ee5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fe6ee5
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-fe6ee5-openshift-default-789585b85b

SuccessfulCreate

Created pod: e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp
(x2)

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-fe6ee5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fe6ee5-openshift-default-789585b85b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-fe6ee5

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-fe6ee5-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-fe6ee5-authn-ssl" already exists

openshift-ingress

multus

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fe6ee5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fe6ee5-6845887b87 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fe6ee5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fe6ee5: serviceaccount "payload-processing-e2e-inf-b-fe6ee5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fe6ee5-6845887b87

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fe6ee5-6845887b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fe6ee5: serviceaccount "payload-processing-e2e-inf-b-fe6ee5" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fe6ee5-6845887b87

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1ee55ce9-554fbddffd-f9xdt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1ee55ce9-66956858c5-4tt8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-1ee55ce9-openshift-default-774686748d-jzgdd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-dd410a86-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb

SuccessfulCreate

Created pod: e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

openshift-ingress

gateway_labeler_controller

e2e-migrate-dd410a86-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-dd410a86-gw
(x2)

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dd410a86-647796f5c8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-dd410a86

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dd410a86: serviceaccount "payload-processing-e2e-migrate-dd410a86" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-dd410a86

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-dd410a86-647796f5c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dd410a86-647796f5c8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-dd410a86-647796f5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dd410a86: serviceaccount "payload-processing-e2e-migrate-dd410a86" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dd410a86-cd6c4b654-6bb5j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-dd410a86-647796f5c8-swlr9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-dd410a86-gw-openshift-default-6749c4c4cb-2k672

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-1c07ea69-openshift-default-847d54c5cb

SuccessfulCreate

Created pod: e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

openshift-ingress

deployment-controller

e2e-ait-1c07ea69-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1c07ea69-openshift-default-847d54c5cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-1c07ea69

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1c07ea69
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1c07ea69-7db94d78c9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1c07ea69-7db94d78c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1c07ea69: serviceaccount "payload-processing-e2e-ait-1c07ea69" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1c07ea69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1c07ea69: serviceaccount "payload-processing-e2e-ait-1c07ea69" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1c07ea69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1c07ea69-7db94d78c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1c07ea69-7db94d78c9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-1c07ea69

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-1c07ea69": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-1c07ea69, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5a6602f0-14e7-4320-b6c2-afe647126577, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-1c07ea69-7db94d78c9-fksvm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1c07ea69-7d8b6b5b74-6qvfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1c07ea69-openshift-default-847d54c5cb-frsww

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-9af6d23e-openshift-default-5dfb969684

SuccessfulCreate

Created pod: e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

openshift-ingress

deployment-controller

e2e-derive-9af6d23e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-9af6d23e-openshift-default-5dfb969684 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-9af6d23e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9af6d23e

openshift-ingress

multus

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-9af6d23e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9af6d23e-7c58b5585

FailedCreate

Error creating: pods "payload-processing-e2e-derive-9af6d23e-7c58b5585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9af6d23e: serviceaccount "payload-processing-e2e-derive-9af6d23e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-9af6d23e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-9af6d23e-7c58b5585 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9af6d23e: serviceaccount "payload-processing-e2e-derive-9af6d23e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9af6d23e-7c58b5585

SuccessfulCreate

Created pod: payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

openshift-ingress

kubelet

payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-0458f0-6486b5497f-ddqdk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0458f0-5b596df974-k8rqp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9af6d23e-7fb8c46794-bm6sg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9af6d23e-7c58b5585-mnnmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-9af6d23e-openshift-default-5dfb969684-zkt94

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-0458f0-openshift-default-7b89fd88bd-55p5g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-767170-openshift-default-65b9b6c956

SuccessfulCreate

Created pod: e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

openshift-ingress

multus

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-767170-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-767170-openshift-default-65b9b6c956 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-767170

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-767170
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-767170-664795fc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-767170-664795fc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-767170: serviceaccount "payload-processing-e2e-explicit-767170" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-767170

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-767170-69d8449c69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-767170-69d8449c69

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-767170-69d8449c69-b7grq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-767170

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-767170-664795fc6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-767170-69d8449c69

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-767170-69d8449c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-767170: serviceaccount "payload-processing-e2e-explicit-767170" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-767170-664795fc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

openshift-ingress

kubelet

payload-processing-e2e-explicit-767170-69d8449c69-b7grq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-767170-69d8449c69-b7grq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-767170-69d8449c69-b7grq

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-767170-69d8449c69-b7grq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-4a43447e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4a43447e

openshift-ingress

multus

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-4a43447e-openshift-default-6dfdc5c984

SuccessfulCreate

Created pod: e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

openshift-ingress

deployment-controller

e2e-mt-4a43447e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4a43447e-openshift-default-6dfdc5c984 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4a43447e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4a43447e-6d6574f785 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4a43447e: serviceaccount "payload-processing-e2e-mt-4a43447e" not found

openshift-ingress

multus

payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4a43447e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4a43447e-6d6574f785

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4a43447e-6d6574f785

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4a43447e-6d6574f785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4a43447e: serviceaccount "payload-processing-e2e-mt-4a43447e" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a43447e-56cd85cf6b-rv9x6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4a43447e-6d6574f785-5r4bs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4a43447e-openshift-default-6dfdc5c984-7hm8x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-767170-664795fc6b-pn62f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-767170-69d8449c69-b7grq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-ebc24f-openshift-default-dc6ff6d9b

SuccessfulCreate

Created pod: e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

openshift-ingress

deployment-controller

e2e-noten-ebc24f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ebc24f-openshift-default-dc6ff6d9b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-ebc24f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ebc24f

openshift-ingress

kubelet

e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94

SuccessfulCreate

Created pod: e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

openshift-ingress

deployment-controller

e2e-shared-a-w2-2b8275-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2b8275-openshift-default-58cd787d94 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

multus

e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-2b8275

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-2b8275

openshift-ingress

kubelet

e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-767170-openshift-default-65b9b6c956-mrt9s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-2b8275

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-2b8275

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-2b8275-5969945d85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2b8275-5969945d85

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-2b8275-5969945d85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2b8275: serviceaccount "payload-processing-e2e-shared-a-w2-2b8275" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2b8275: serviceaccount "payload-processing-e2e-shared-a-w2-2b8275" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2b8275-5969945d85

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-6e2bb9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-6e2bb9

openshift-ingress

deployment-controller

e2e-shared-b-w2-6e2bb9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b

SuccessfulCreate

Created pod: e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

openshift-ingress

multus

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-6e2bb9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6e2bb9: serviceaccount "payload-processing-e2e-shared-b-w2-6e2bb9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-6e2bb9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6e2bb9: serviceaccount "payload-processing-e2e-shared-b-w2-6e2bb9" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-5cdd59e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-5cdd59e7

openshift-ingress

deployment-controller

e2e-mt-5cdd59e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-5cdd59e7-openshift-default-79794f765b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-5cdd59e7-openshift-default-79794f765b

SuccessfulCreate

Created pod: e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

openshift-ingress

multus

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-96cfc6-69bd59fcf-rxmkq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-96cfc6-fccd494f8-skkd7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-96cfc6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-96cfc6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-96cfc6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-96cfc6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a8e89ff0-8511-47e1-9e35-07389360d2f4, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5cdd59e7: serviceaccount "payload-processing-e2e-mt-5cdd59e7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5cdd59e7-cdbcc798f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

openshift-ingress

kubelet

payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-5cdd59e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-5cdd59e7-cdbcc798f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-5cdd59e7-cdbcc798f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-5cdd59e7-cdbcc798f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-5cdd59e7: serviceaccount "payload-processing-e2e-mt-5cdd59e7" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-5cdd59e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-96cfc6-openshift-default-557b7b668d-wwvw4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-ebc24f-openshift-default-dc6ff6d9b-dwxwf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe6ee5-6845887b87-fc7sw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe6ee5-5656d899b6-hdnrg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-b88b90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-b88b90

openshift-ingress

deployment-controller

e2e-shared-a-w3-b88b90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754

SuccessfulCreate

Created pod: e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

openshift-ingress

multus

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-fe6ee5-openshift-default-789585b85b-t96mp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b88b90: serviceaccount "payload-processing-e2e-shared-a-w3-b88b90" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-b88b90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-b88b90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b88b90: serviceaccount "payload-processing-e2e-shared-a-w3-b88b90" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-b79988

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-b79988

openshift-ingress

replicaset-controller

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4

SuccessfulCreate

Created pod: e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

openshift-ingress

deployment-controller

e2e-shared-b-w3-b79988-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-b79988

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b79988-69c4d67575

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b79988: serviceaccount "payload-processing-e2e-shared-b-w3-b79988" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-b79988-69c4d67575

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-b79988-69c4d67575-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-b79988: serviceaccount "payload-processing-e2e-shared-b-w3-b79988" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-b79988

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-b79988-69c4d67575 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

Unhealthy

Startup probe failed: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

ProbeError

Startup probe error: Get "http://10.132.0.91:15021/healthz/ready": dial tcp 10.132.0.91:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-5cdd59e7-cdbcc798f-l77vm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-5cdd59e7-5f7b865c46-ldd4f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-5cdd59e7-openshift-default-79794f765b-v742h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-6fce83-openshift-default-5658884b46

SuccessfulCreate

Created pod: e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

openshift-ingress

deployment-controller

e2e-api-a-6fce83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6fce83-openshift-default-5658884b46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-6fce83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6fce83

openshift-ingress

multus

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6fce83-6ffcf884fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6fce83-6ffcf884fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6fce83-6ffcf884fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6fce83: serviceaccount "payload-processing-e2e-api-a-6fce83" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6fce83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6fce83-6ffcf884fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6fce83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6fce83-756cb4ff86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6fce83: serviceaccount "payload-processing-e2e-api-a-6fce83" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-a77c87-openshift-default-5f67cb465b

SuccessfulCreate

Created pod: e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

openshift-ingress

deployment-controller

e2e-api-b-a77c87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a77c87-openshift-default-5f67cb465b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a77c87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a77c87

openshift-ingress

multus

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a77c87-79dc65666c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a77c87-7d45798446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a77c87-7d45798446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a77c87: serviceaccount "payload-processing-e2e-api-b-a77c87" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a77c87-79dc65666c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a77c87-79dc65666c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a77c87: serviceaccount "payload-processing-e2e-api-b-a77c87" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a77c87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a77c87-79dc65666c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a77c87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a77c87-7d45798446 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a77c87-7d45798446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-d9b17d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-d9b17d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-d9b17d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-d9b17d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eb114bed-6bd9-4932-825e-efd70b1e9a8d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-d9b17d-67659db75d-fl9f9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-d9b17d-5467978d5c-bnpsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6fce83-6ffcf884fc-phjkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6fce83-756cb4ff86-h5f5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-d9b17d-openshift-default-6f7786f4fd-cfr6s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-6fce83-openshift-default-5658884b46-xp7v2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-a77c87-79dc65666c-fcv9h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a77c87-7d45798446-snk22

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-a77c87-openshift-default-5f67cb465b-k2xpv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b8275-5969945d85-dz2mk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b8275-bd486d4b-vqxsf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-2b8275-openshift-default-58cd787d94-5lh7l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6e2bb9-86c97cb84b-8v6db

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6e2bb9-8569f6c4c9-jq484

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-6e2bb9-openshift-default-64656c457b-lsbqt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-079b38-6f96f9498-4mx2n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-079b38-5d8f46b7bf-2ctwl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-079b38-openshift-default-778d985f94-q6949

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-911a82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-911a82

openshift-ingress

replicaset-controller

e2e-ipp-a-911a82-openshift-default-55764bfb98

SuccessfulCreate

Created pod: e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

openshift-ingress

deployment-controller

e2e-ipp-a-911a82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-911a82-openshift-default-55764bfb98 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-911a82: serviceaccount "payload-processing-e2e-ipp-a-911a82" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-911a82: serviceaccount "payload-processing-e2e-ipp-a-911a82" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-911a82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-911a82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Unhealthy

Readiness probe failed: Get "http://10.132.0.109:15021/healthz/ready": read tcp 10.132.0.2:36274->10.132.0.109:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

ProbeError

Readiness probe error: Get "http://10.132.0.109:15021/healthz/ready": read tcp 10.132.0.2:36274->10.132.0.109:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-166f16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-166f16

openshift-ingress

replicaset-controller

e2e-ipp-b-166f16-openshift-default-6f8758d8d4

SuccessfulCreate

Created pod: e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

openshift-ingress

multus

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

AddedInterface

Add eth0 [10.132.0.110/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-166f16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-166f16-openshift-default-6f8758d8d4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-166f16-74786b5947

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-166f16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-166f16-74786b5947

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-166f16-74786b5947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-166f16: serviceaccount "payload-processing-e2e-ipp-b-166f16" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-166f16: serviceaccount "payload-processing-e2e-ipp-b-166f16" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-166f16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-166f16-74786b5947 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

ProbeError

Readiness probe error: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Unhealthy

Readiness probe failed: Get "http://10.132.0.110:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

ProbeError

Startup probe error: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Unhealthy

Startup probe failed: Get "http://10.132.0.110:15021/healthz/ready": dial tcp 10.132.0.110:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-cd2006

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-cd2006

openshift-ingress

multus

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

AddedInterface

Add eth0 [10.132.0.114/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-cd2006

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-cd2006-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-cd2006-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

openshift-ingress

deployment-controller

e2e-ipp-cleanup-cd2006-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-cd2006

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-cd2006

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cd2006: serviceaccount "payload-processing-e2e-ipp-cleanup-cd2006" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cd2006: serviceaccount "payload-processing-e2e-ipp-cleanup-cd2006" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

Unhealthy

Startup probe failed: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

ProbeError

Startup probe error: Get "http://10.132.0.114:15021/healthz/ready": dial tcp 10.132.0.114:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cd2006-697fdf59cd-2qgtn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cd2006-5bd48785b5-blcdp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cd2006-openshift-default-5f89779d7d-nqqfl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-911a82-6ddb6fd6fc-g5vx8

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-911a82

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-911a82": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-911a82, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 81e17256-e61b-4487-9fd2-55a1126f7db6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-911a82-66ff6c45b6-mng9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-911a82-openshift-default-55764bfb98-52mmf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-166f16-5777cbb8f8-42pvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-166f16-74786b5947-zp6vl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-166f16-openshift-default-6f8758d8d4-wdvbg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-b88b90

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-b88b90": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b88b90, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d03bc78e-9148-4f08-b2f7-47944a5c27d8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b88b90-7c965d4c66-lhvfm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b88b90-79b4d8b6f-hvgxf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b88b90-openshift-default-7dc4ffc754-qh27l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-b79988-fff9dd8c4-5kgkm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-b79988-69c4d67575-xdnjw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-b79988

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b79988: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-b79988": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-b79988, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4feddbf5-4207-4f2c-8986-8962839aba2a, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-b79988-openshift-default-5cb7b5cfb4-6wgdk

Killing

Stopping container istio-proxy