Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5 to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8 to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4 to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27 to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9 to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-4jzpw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-4jzpw to ip-10-0-129-195.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-7x9t7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-7x9t7 to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

Scheduled

Successfully assigned openshift-ingress/e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk to ip-10-0-140-144.ec2.internal

openshift-ingress

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

Scheduled

Successfully assigned openshift-ingress/e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m to ip-10-0-140-144.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958 to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj to ip-10-0-140-144.ec2.internal

openshift-ingress

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b to ip-10-0-140-144.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-44l86

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-44l86 to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz to ip-10-0-136-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-t98fx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t98fx to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9 to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

Scheduled

Successfully assigned openshift-ingress/e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84 to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8 to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g to ip-10-0-129-195.ec2.internal

openshift-ingress

router-default-7956fdcb7d-pftq7

Scheduled

Successfully assigned openshift-ingress/router-default-7956fdcb7d-pftq7 to ip-10-0-140-144.ec2.internal

openshift-ingress

kube-auth-proxy-8494df7896-tszz7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8494df7896-tszz7 to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7 to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4 to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-20588104-748c69fff7-xhvp2 to ip-10-0-129-195.ec2.internal

openshift-ingress

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c to ip-10-0-140-144.ec2.internal

openshift-ingress

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc to ip-10-0-140-144.ec2.internal

openshift-ingress

kube-auth-proxy-8494df7896-ch7vt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-8494df7896-ch7vt to ip-10-0-140-144.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-rjfcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-rjfcb to ip-10-0-136-92.ec2.internal

openshift-ingress

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw to ip-10-0-136-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9 to ip-10-0-129-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq to ip-10-0-140-144.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7956fdcb7d from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-7956fdcb7d

FailedCreate

Error creating: pods "router-default-7956fdcb7d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7956fdcb7d

FailedCreate

Error creating: pods "router-default-7956fdcb7d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7956fdcb7d

SuccessfulCreate

Created pod: router-default-7956fdcb7d-pftq7
(x6)

openshift-ingress

kubelet

router-default-7956fdcb7d-pftq7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-7956fdcb7d-pftq7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-7956fdcb7d-pftq7

AddedInterface

Add eth0 [10.134.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7956fdcb7d-pftq7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-7956fdcb7d-pftq7

Started

Started container router

openshift-ingress

kubelet

router-default-7956fdcb7d-pftq7

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-8494df7896 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-8494df7896-ch7vt

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-8494df7896

SuccessfulCreate

Created pod: kube-auth-proxy-8494df7896-ch7vt

openshift-ingress

replicaset-controller

kube-auth-proxy-8494df7896

SuccessfulCreate

Created pod: kube-auth-proxy-8494df7896-tszz7
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-8494df7896

FailedCreate

Error creating: pods "kube-auth-proxy-8494df7896-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-ch7vt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-tszz7

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : failed to sync secret cache: timed out waiting for the condition

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-44l86

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-tszz7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-8494df7896-tszz7

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-ch7vt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-ch7vt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-ch7vt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.191s (3.191s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-44l86

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-tszz7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.53s (2.53s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-tszz7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-8494df7896-tszz7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.235s (3.235s including waiting). Image size: 181126104 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.259s (3.259s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zkwht

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-7x9t7

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7x9t7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-7x9t7

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7x9t7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.815s (2.815s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7x9t7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7x9t7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7x9t7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-7x9t7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-44l86

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-44l86

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-t98fx

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-t98fx

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-rjfcb

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-4jzpw

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-4jzpw

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjfcb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-rjfcb

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4jzpw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4jzpw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjfcb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.688s (1.688s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4jzpw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-4jzpw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.249s (2.249s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjfcb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-rjfcb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t98fx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t98fx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t98fx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t98fx

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t98fx

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-be0c80

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-be0c80

openshift-ingress

multus

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-be0c80-openshift-default-69bb677578

SuccessfulCreate

Created pod: e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

openshift-ingress

deployment-controller

e2e-inf-a-be0c80-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-be0c80-openshift-default-69bb677578 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-be0c80-86796fb4d5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-be0c80-86796fb4d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-be0c80: serviceaccount "payload-processing-e2e-inf-a-be0c80" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-be0c80-86796fb4d5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-be0c80: serviceaccount "payload-processing-e2e-inf-a-be0c80" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-be0c80

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-be0c80

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-be0c80-86796fb4d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-2a21d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-2a21d9-openshift-default-fdd64446d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-2a21d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-2a21d9

openshift-ingress

gateway_labeler_controller

e2e-ait-1dc719b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1dc719b7

openshift-ingress

replicaset-controller

e2e-ait-1dc719b7-openshift-default-54bb75d7fb

SuccessfulCreate

Created pod: e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

openshift-ingress

deployment-controller

e2e-ait-1dc719b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1dc719b7-openshift-default-54bb75d7fb from 0 to 1

openshift-ingress

multus

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-2a21d9-openshift-default-fdd64446d

SuccessfulCreate

Created pod: e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

openshift-ingress

multus

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1dc719b7-b57689b7f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1dc719b7-b57689b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1dc719b7: serviceaccount "payload-processing-e2e-ait-1dc719b7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1dc719b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1dc719b7-b57689b7f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1dc719b7: serviceaccount "payload-processing-e2e-ait-1dc719b7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1dc719b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1dc719b7-b57689b7f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-2a21d9-97df49886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-2a21d9-97df49886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-2a21d9: serviceaccount "payload-processing-e2e-autores-2a21d9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-2a21d9-5cf44fb47

FailedCreate

Error creating: pods "payload-processing-e2e-autores-2a21d9-5cf44fb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-2a21d9: serviceaccount "payload-processing-e2e-autores-2a21d9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-2a21d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-2a21d9-97df49886 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-2a21d9-97df49886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

openshift-ingress

multus

payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-2a21d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-2a21d9-5cf44fb47 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-2a21d9-5cf44fb47

SuccessfulCreate

Created pod: payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

openshift-ingress

multus

payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c6156e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c6156e

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.74s (3.74s including waiting). Image size: 166449337 bytes.

openshift-ingress

multus

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-inf-b-c6156e-openshift-default-67dd98c676

SuccessfulCreate

Created pod: e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

openshift-ingress

deployment-controller

e2e-inf-b-c6156e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c6156e-openshift-default-67dd98c676 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c6156e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c6156e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c6156e-96c8985d7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c6156e-96c8985d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c6156e-96c8985d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c6156e: serviceaccount "payload-processing-e2e-inf-b-c6156e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c6156e: serviceaccount "payload-processing-e2e-inf-b-c6156e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c6156e-96c8985d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1dc719b7-b57689b7f-zkbb5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1dc719b7-9b6f9d95d-k7zv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1dc719b7-openshift-default-54bb75d7fb-8tgmt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-59484b3d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-59484b3d-gw-openshift-default-5b58f7584 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-59484b3d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-59484b3d-gw

openshift-ingress

replicaset-controller

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584

SuccessfulCreate

Created pod: e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

openshift-ingress

multus

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-59484b3d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-59484b3d-654f7fb486 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-59484b3d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-59484b3d-866f76dc46 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-59484b3d: serviceaccount "payload-processing-e2e-migrate-59484b3d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-59484b3d-654f7fb486

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-59484b3d-654f7fb486

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-59484b3d-654f7fb486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-59484b3d: serviceaccount "payload-processing-e2e-migrate-59484b3d" not found

openshift-ingress

multus

payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-59484b3d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-59484b3d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-59484b3d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-59484b3d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 07ce2902-4b2b-4a65-9c3d-c3dc2dbf842e, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-59484b3d-866f76dc46-dj89b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-59484b3d-654f7fb486-wrfk8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-59484b3d-gw-openshift-default-5b58f7584-msjhc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-65bba332-openshift-default-588bffbff6

SuccessfulCreate

Created pod: e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

openshift-ingress

gateway_labeler_controller

e2e-ait-65bba332

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-65bba332

openshift-ingress

deployment-controller

e2e-ait-65bba332-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-65bba332-openshift-default-588bffbff6 from 0 to 1

openshift-ingress

multus

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-65bba332-7bf9594c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

openshift-ingress

multus

payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-65bba332

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-65bba332-7bf9594c66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-65bba332-68445fc5cf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-65bba332-7bf9594c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-65bba332-7bf9594c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-65bba332: serviceaccount "payload-processing-e2e-ait-65bba332" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-65bba332

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-65bba332-68445fc5cf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-65bba332-68445fc5cf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-65bba332-68445fc5cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-65bba332: serviceaccount "payload-processing-e2e-ait-65bba332" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-65bba332-68445fc5cf-4fzgb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-65bba332-7bf9594c66-c8czn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-65bba332-openshift-default-588bffbff6-sxdjh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-d609a19a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d609a19a

openshift-ingress

multus

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-d609a19a-openshift-default-657d85d5cb

SuccessfulCreate

Created pod: e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

openshift-ingress

deployment-controller

e2e-derive-d609a19a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-d609a19a-openshift-default-657d85d5cb from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d609a19a-88c5fb969

FailedCreate

Error creating: pods "payload-processing-e2e-derive-d609a19a-88c5fb969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d609a19a: serviceaccount "payload-processing-e2e-derive-d609a19a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d609a19a-88c5fb969

SuccessfulCreate

Created pod: payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

openshift-ingress

deployment-controller

payload-processing-e2e-derive-d609a19a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-d609a19a-88c5fb969 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-d609a19a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-d609a19a-c89d86558 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d609a19a-c89d86558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-d609a19a-c89d86558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d609a19a: serviceaccount "payload-processing-e2e-derive-d609a19a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d609a19a-c89d86558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

openshift-ingress

multus

payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d609a19a-c89d86558-vkqfs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d609a19a-88c5fb969-brz7m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-d609a19a-openshift-default-657d85d5cb-blv84

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-2a21d9-5cf44fb47-kb958

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2a21d9-97df49886-42hhc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-bef04b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-bef04b-openshift-default-777d6c5548 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-bef04b-openshift-default-777d6c5548

SuccessfulCreate

Created pod: e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

openshift-ingress

gateway_labeler_controller

e2e-explicit-bef04b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-bef04b

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-2a21d9-openshift-default-fdd64446d-p6wsz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-bef04b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-bef04b-7d6c9658bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bef04b-7d6c9658bf

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-bef04b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bef04b-7d6c9658bf

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-bef04b-7d6c9658bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bef04b: serviceaccount "payload-processing-e2e-explicit-bef04b" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bef04b: serviceaccount "payload-processing-e2e-explicit-bef04b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-20588104-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-20588104-openshift-default-7fd8d85bcb from 0 to 1

openshift-ingress

multus

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-20588104

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-20588104

openshift-ingress

replicaset-controller

e2e-mt-20588104-openshift-default-7fd8d85bcb

SuccessfulCreate

Created pod: e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-20588104-748c69fff7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

openshift-ingress

deployment-controller

payload-processing-e2e-mt-20588104

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-20588104-748c69fff7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-20588104

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-20588104-69999448c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-20588104-69999448c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-20588104-69999448c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-20588104-69999448c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-20588104: serviceaccount "payload-processing-e2e-mt-20588104" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-20588104-748c69fff7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-20588104-748c69fff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-20588104: serviceaccount "payload-processing-e2e-mt-20588104" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bef04b-7d5644c4b6-wdc5g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bef04b-7d6c9658bf-gthzk

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-bef04b-openshift-default-777d6c5548-dfklf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-ea85ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ea85ff

openshift-ingress

kubelet

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b

SuccessfulCreate

Created pod: e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

openshift-ingress

deployment-controller

e2e-noten-ea85ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ea85ff-openshift-default-7f5c9d6f8b from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-noten-ea85ff

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-ea85ff-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-ea85ff-authn-ssl" already exists

openshift-ingress

kubelet

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-20588104-748c69fff7-xhvp2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-20588104-69999448c8-4phd9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-ea85ff-openshift-default-7f5c9d6f8b-42s2k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-20588104-openshift-default-7fd8d85bcb-wz277

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-be0c80-6dbb6f9f9d-kpgzk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-be0c80-86796fb4d5-xr2p4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-be0c80-openshift-default-69bb677578-klxb8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-fb993c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fb993c-openshift-default-54c78c6946 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-fb993c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fb993c

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946

SuccessfulCreate

Created pod: e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

openshift-ingress

multus

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fb993c: serviceaccount "payload-processing-e2e-shared-a-w2-fb993c" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fb993c: serviceaccount "payload-processing-e2e-shared-a-w2-fb993c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-fb993c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-fb993c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c6156e-96c8985d7-z7p2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c6156e-6659fbbf66-jx9dk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-c6156e-openshift-default-67dd98c676-dbv55

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1e2e7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1e2e7d

openshift-ingress

deployment-controller

e2e-shared-a-w3-1e2e7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6

SuccessfulCreate

Created pod: e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

ProbeError

Readiness probe error: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Unhealthy

Readiness probe failed: Get "http://10.133.0.80:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1e2e7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1e2e7d: serviceaccount "payload-processing-e2e-shared-a-w3-1e2e7d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1e2e7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1e2e7d: serviceaccount "payload-processing-e2e-shared-a-w3-1e2e7d" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w2-335a68-openshift-default-dcf4788d

SuccessfulCreate

Created pod: e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-335a68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-335a68-openshift-default-dcf4788d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-335a68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-335a68

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-335a68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-335a68-68759bc987 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-335a68: serviceaccount "payload-processing-e2e-shared-b-w2-335a68" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-335a68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-335a68-68759bc987

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-335a68-68759bc987-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-335a68: serviceaccount "payload-processing-e2e-shared-b-w2-335a68" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-335a68-68759bc987

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Unhealthy

Readiness probe failed: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

ProbeError

Readiness probe error: Get "http://10.133.0.81:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-031a56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-031a56

openshift-ingress

deployment-controller

e2e-shared-b-w3-031a56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-031a56-openshift-default-5487d645cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-031a56-openshift-default-5487d645cd

SuccessfulCreate

Created pod: e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

openshift-ingress

multus

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-031a56: serviceaccount "payload-processing-e2e-shared-b-w3-031a56" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-031a56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-031a56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-031a56-7dccc75645 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-031a56-7dccc75645

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-031a56-7dccc75645

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-031a56-7dccc75645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-031a56: serviceaccount "payload-processing-e2e-shared-b-w3-031a56" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Started

Started container istio-proxy

openshift-ingress

multus

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-557930d3-openshift-default-6d7c8b84dd

SuccessfulCreate

Created pod: e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

openshift-ingress

deployment-controller

e2e-mt-557930d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-557930d3-openshift-default-6d7c8b84dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-557930d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-557930d3
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-557930d3-56f9db478b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

openshift-ingress

deployment-controller

payload-processing-e2e-mt-557930d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-557930d3-5c5bbbf645 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-557930d3-5c5bbbf645

FailedCreate

Error creating: pods "payload-processing-e2e-mt-557930d3-5c5bbbf645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-557930d3: serviceaccount "payload-processing-e2e-mt-557930d3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-557930d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-557930d3-56f9db478b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-557930d3-56f9db478b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-557930d3-56f9db478b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-557930d3: serviceaccount "payload-processing-e2e-mt-557930d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-557930d3-5c5bbbf645

SuccessfulCreate

Created pod: payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

openshift-ingress

multus

payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-557930d3-5c5bbbf645-knpr4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-557930d3-56f9db478b-zmphz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-557930d3-openshift-default-6d7c8b84dd-bd6tr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-d52edb-openshift-default-59bb6c8c96

SuccessfulCreate

Created pod: e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

openshift-ingress

deployment-controller

e2e-api-a-d52edb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d52edb-openshift-default-59bb6c8c96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-d52edb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d52edb

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d52edb-58ff7fb7f9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d52edb-7466577fb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d52edb-7466577fb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d52edb-7466577fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d52edb: serviceaccount "payload-processing-e2e-api-a-d52edb" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d52edb-58ff7fb7f9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d52edb-58ff7fb7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d52edb: serviceaccount "payload-processing-e2e-api-a-d52edb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d52edb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d52edb-7466577fb6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d52edb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d52edb-58ff7fb7f9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-bfa49a-openshift-default-76bfb4b488

SuccessfulCreate

Created pod: e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

openshift-ingress

gateway_labeler_controller

e2e-api-b-bfa49a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-bfa49a

openshift-ingress

deployment-controller

e2e-api-b-bfa49a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-bfa49a-openshift-default-76bfb4b488 from 0 to 1

openshift-ingress

multus

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bfa49a-67f9c4f799

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bfa49a-67f9c4f799

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-bfa49a-67f9c4f799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bfa49a: serviceaccount "payload-processing-e2e-api-b-bfa49a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-bfa49a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-bfa49a-64946bc85d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-bfa49a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-bfa49a-67f9c4f799 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bfa49a: serviceaccount "payload-processing-e2e-api-b-bfa49a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

ProbeError

Startup probe error: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Unhealthy

Startup probe failed: Get "http://10.133.0.88:15021/healthz/ready": dial tcp 10.133.0.88:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d52edb-7466577fb6-7xn27

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d52edb-58ff7fb7f9-b64vt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-a-d52edb-openshift-default-59bb6c8c96-jv5bg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bfa49a-64946bc85d-sg69g

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-bfa49a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-bfa49a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-bfa49a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-bfa49a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0e850034-9dce-4a1e-9d31-6b7fc029efd1, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-bfa49a-67f9c4f799-l6rdj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-bfa49a-openshift-default-76bfb4b488-rq6s5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fb993c-6c8ff4c9df-hskhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fb993c-d98bc5f74-hml4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-fb993c-openshift-default-54c78c6946-67xfb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-335a68-68759bc987-s2mbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-335a68-7d4b6f6598-tkccq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-335a68-openshift-default-dcf4788d-mjgbz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-30989f-openshift-default-5d85d49d8

SuccessfulCreate

Created pod: e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

openshift-ingress

deployment-controller

e2e-ipp-a-30989f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-30989f-openshift-default-5d85d49d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-30989f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-30989f

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-30989f

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-30989f-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-30989f-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-30989f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-30989f-675db65d55 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-30989f-55c6764894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-30989f-55c6764894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-30989f-55c6764894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-30989f: serviceaccount "payload-processing-e2e-ipp-a-30989f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-30989f-675db65d55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-30989f-675db65d55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-30989f: serviceaccount "payload-processing-e2e-ipp-a-30989f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-30989f-675db65d55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-30989f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-30989f-55c6764894 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Unhealthy

Readiness probe failed: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

ProbeError

Readiness probe error: Get "http://10.133.0.94:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b7d522

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b7d522

openshift-ingress

deployment-controller

e2e-ipp-b-b7d522-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b7d522-openshift-default-5d649d4f68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-b7d522-openshift-default-5d649d4f68

SuccessfulCreate

Created pod: e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b7d522

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b7d522-7968dd9999

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b7d522

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b7d522-7968dd9999 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b7d522-7968dd9999

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b7d522-7968dd9999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b7d522: serviceaccount "payload-processing-e2e-ipp-b-b7d522" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b7d522: serviceaccount "payload-processing-e2e-ipp-b-b7d522" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

ProbeError

Startup probe error: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

Unhealthy

Startup probe failed: Get "http://10.133.0.95:15021/healthz/ready": dial tcp 10.133.0.95:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-e83e82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-e83e82

openshift-ingress

multus

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-e83e82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db

SuccessfulCreate

Created pod: e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-e83e82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-e83e82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e83e82: serviceaccount "payload-processing-e2e-ipp-cleanup-e83e82" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e83e82: serviceaccount "payload-processing-e2e-ipp-cleanup-e83e82" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

ProbeError

Startup probe error: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

Unhealthy

Startup probe failed: Get "http://10.133.0.96:15021/healthz/ready": dial tcp 10.133.0.96:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e83e82-67f9d6c86f-g7gtt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-e83e82

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e83e82: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-e83e82": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e83e82, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8114587b-e3f9-4e42-8cc8-e9f5f14b6de6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e83e82-574cf88bf4-bz6fs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-e83e82-openshift-default-756bf5d7db-gqpf7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-30989f-55c6764894-qqlph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-30989f-675db65d55-5whvw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-30989f-openshift-default-5d85d49d8-ftcq7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

Unhealthy

Readiness probe failed: dial tcp 10.134.0.74:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b7d522-5c7b8c8d74-jxkrk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b7d522-7968dd9999-454gc

Unhealthy

Readiness probe failed: dial tcp 10.134.0.73:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-b7d522-openshift-default-5d649d4f68-c5w8h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1e2e7d-6dd8475666-flg8c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1e2e7d-79c995695f-lz7k7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1e2e7d-openshift-default-7dd798d7c6-bp5vw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-031a56-7dccc75645-7jrff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-031a56-749f8bc5c4-mspm9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-031a56-openshift-default-5487d645cd-9vgs5

Killing

Stopping container istio-proxy