Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5 to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj to ip-10-0-130-78.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bct8dwv to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb to ip-10-0-132-229.ec2.internal

openshift-ingress

kube-auth-proxy-c66559bbb-jdc69

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-c66559bbb-jdc69 to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg to ip-10-0-130-118.ec2.internal

openshift-ingress

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb to ip-10-0-132-229.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw to ip-10-0-130-78.ec2.internal

openshift-ingress

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9 to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr to ip-10-0-130-118.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qv5bq to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66 to ip-10-0-130-118.ec2.internal

openshift-ingress

kube-auth-proxy-c66559bbb-6lzls

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-c66559bbb-6lzls to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4 to ip-10-0-130-78.ec2.internal

openshift-ingress

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2 to ip-10-0-130-78.ec2.internal

openshift-ingress

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn to ip-10-0-130-78.ec2.internal

openshift-ingress

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8 to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94 to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c to ip-10-0-130-118.ec2.internal

openshift-ingress

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47 to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-p97c7

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-p97c7 to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk to ip-10-0-130-118.ec2.internal

openshift-ingress

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29 to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-hz7jn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-hz7jn to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57 to ip-10-0-130-118.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5 to ip-10-0-130-118.ec2.internal

openshift-ingress

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-fvbcs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-fvbcs to ip-10-0-130-78.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-4lccv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4lccv to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5 to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7 to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd to ip-10-0-130-118.ec2.internal

openshift-ingress

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx to ip-10-0-130-78.ec2.internal

openshift-ingress

router-default-6bd44bd444-kdgsw

Scheduled

Successfully assigned openshift-ingress/router-default-6bd44bd444-kdgsw to ip-10-0-130-78.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z to ip-10-0-132-229.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-tzknv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-tzknv to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4 to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv to ip-10-0-132-229.ec2.internal

openshift-ingress

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z to ip-10-0-130-78.ec2.internal

openshift-ingress

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2 to ip-10-0-132-229.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-bbxqv

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-bbxqv to ip-10-0-130-78.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6bd44bd444 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-6bd44bd444

FailedCreate

Error creating: pods "router-default-6bd44bd444-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6bd44bd444

FailedCreate

Error creating: pods "router-default-6bd44bd444-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6bd44bd444

SuccessfulCreate

Created pod: router-default-6bd44bd444-kdgsw
(x5)

openshift-ingress

kubelet

router-default-6bd44bd444-kdgsw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6bd44bd444-kdgsw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6bd44bd444-kdgsw

Started

Started container router

openshift-ingress

kubelet

router-default-6bd44bd444-kdgsw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-6bd44bd444-kdgsw

Created

Created container: router

openshift-ingress

multus

router-default-6bd44bd444-kdgsw

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-c66559bbb

SuccessfulCreate

Created pod: kube-auth-proxy-c66559bbb-6lzls

openshift-ingress

replicaset-controller

kube-auth-proxy-c66559bbb

SuccessfulCreate

Created pod: kube-auth-proxy-c66559bbb-jdc69

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-jdc69

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-6lzls

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-c66559bbb

FailedCreate

Error creating: pods "kube-auth-proxy-c66559bbb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-c66559bbb from 0 to 2

openshift-ingress

multus

kube-auth-proxy-c66559bbb-6lzls

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-jdc69

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-c66559bbb-jdc69

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-6lzls

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-4lccv

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-4lccv

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-jdc69

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.943s (2.943s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-jdc69

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-jdc69

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-6lzls

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 4.16s (4.16s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.413s (3.413s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-6lzls

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-c66559bbb-6lzls

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.791s (2.791s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.066s (3.066s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-5ncqw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bct8dwv

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tzknv

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-tzknv

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tzknv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tzknv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-tzknv

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tzknv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tzknv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-4lccv

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4lccv

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-qv5bq

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.403s (3.403s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p97c7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-hz7jn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-p97c7

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-hz7jn

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hz7jn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-p97c7

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hz7jn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hz7jn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hz7jn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.794s (1.794s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p97c7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.333s (1.333s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p97c7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p97c7

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

ProbeError

Readiness probe error: Get "http://10.133.0.23:15021/healthz/ready": read tcp 10.133.0.2:56228->10.133.0.23:15021: read: connection reset by peer body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Unhealthy

Readiness probe failed: Get "http://10.133.0.23:15021/healthz/ready": read tcp 10.133.0.2:56228->10.133.0.23:15021: read: connection reset by peer

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qv5bq

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-p97c7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hz7jn

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

FailedCreate

Error creating: pods "payload-processing-85fd65c94c-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-bbxqv

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-fvbcs

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

FailedCreate

Error creating: pods "payload-pre-processing-76f657cdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-76f657cdc4-fvbcs

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-fvbcs

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-processing-85fd65c94c-bbxqv

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-85fd65c94c-bbxqv

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-85fd65c94c-bbxqv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.268s (1.268s including waiting). Image size: 141049839 bytes.

openshift-ingress

kubelet

payload-processing-85fd65c94c-bbxqv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-bbxqv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-fvbcs

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.237s (1.237s including waiting). Image size: 141049839 bytes.

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-fvbcs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-fvbcs

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-cc289c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-cc289c

openshift-ingress

replicaset-controller

e2e-worker-w3-9d9f36-openshift-default-84fc56f996

SuccessfulCreate

Created pod: e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

openshift-ingress

gateway_labeler_controller

e2e-inf-a-bcb770

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-bcb770

openshift-ingress

deployment-controller

e2e-worker-w3-9d9f36-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-9d9f36-openshift-default-84fc56f996 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-9d9f36

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-9d9f36

openshift-ingress

replicaset-controller

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48

SuccessfulCreate

Created pod: e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

openshift-ingress

deployment-controller

e2e-worker-w0-cc289c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-cc289c-openshift-default-5d8fc56c48 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b

SuccessfulCreate

Created pod: e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

openshift-ingress

deployment-controller

e2e-inf-a-bcb770-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-bcb770-openshift-default-64fb9d4f9b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cc289c-8554c969bc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-cc289c-8554c969bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cc289c: serviceaccount "payload-processing-e2e-worker-w0-cc289c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-cc289c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-cc289c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-cc289c-8554c969bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cc289c-8554c969bc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cc289c: serviceaccount "payload-processing-e2e-worker-w0-cc289c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9d9f36: serviceaccount "payload-processing-e2e-worker-w3-9d9f36" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-9d9f36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-9d9f36-7f5568cf95 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-9d9f36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-9d9f36: serviceaccount "payload-processing-e2e-worker-w3-9d9f36" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-bcb770

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-bcb770-7fc555fbdc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bcb770: serviceaccount "payload-processing-e2e-inf-a-bcb770" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bcb770-7fc555fbdc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-bcb770-7fc555fbdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-bcb770: serviceaccount "payload-processing-e2e-inf-a-bcb770" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-bcb770

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-bcb770-7fc555fbdc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

openshift-ingress

multus

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-6cc65f16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6cc65f16

openshift-ingress

multus

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd

SuccessfulCreate

Created pod: e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

openshift-ingress

deployment-controller

e2e-ait-6cc65f16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6cc65f16-openshift-default-5ff6f96fdd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.225s (2.225s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.664s (2.664s including waiting). Image size: 166449312 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6cc65f16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6cc65f16-95586fdc5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6cc65f16-95586fdc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6cc65f16-95586fdc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6cc65f16: serviceaccount "payload-processing-e2e-ait-6cc65f16" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6cc65f16-696f658d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6cc65f16-696f658d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6cc65f16: serviceaccount "payload-processing-e2e-ait-6cc65f16" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6cc65f16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6cc65f16-696f658d98 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6cc65f16-696f658d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6cc65f16-95586fdc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

openshift-ingress

multus

payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Unhealthy

Readiness probe failed: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

ProbeError

Readiness probe error: Get "http://10.133.0.28:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-897f61

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-897f61

openshift-ingress

deployment-controller

e2e-inf-b-897f61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-897f61-openshift-default-757d7cbcd6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-897f61-openshift-default-757d7cbcd6

SuccessfulCreate

Created pod: e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

openshift-ingress

multus

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-897f61

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-897f61-55bfc459bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-897f61-7ccb4f565

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-897f61-7ccb4f565

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-897f61-7ccb4f565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-897f61: serviceaccount "payload-processing-e2e-inf-b-897f61" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-897f61: serviceaccount "payload-processing-e2e-inf-b-897f61" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-897f61

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-897f61-7ccb4f565 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ait-6cc65f16-openshift-default-5ff6f96fdd-rbxmq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6cc65f16-696f658d98-zpkq7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6cc65f16-95586fdc5-dnv7z

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-e8c645ee-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e8c645ee-gw

openshift-ingress

replicaset-controller

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8

SuccessfulCreate

Created pod: e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

openshift-ingress

deployment-controller

e2e-migrate-e8c645ee-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8 from 0 to 1

openshift-ingress

multus

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e8c645ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e8c645ee: serviceaccount "payload-processing-e2e-migrate-e8c645ee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e8c645ee-b86775758

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e8c645ee-b86775758

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e8c645ee-b86775758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e8c645ee: serviceaccount "payload-processing-e2e-migrate-e8c645ee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e8c645ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e8c645ee-b86775758 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-e8c645ee-gw-openshift-default-dockercfg-bzv59); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-migrate-e8c645ee-b86775758-nm5rc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e8c645ee-64876bcfb6-4qvr8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-b0eada48-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b0eada48-openshift-default-5d7bf7dd58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-b0eada48

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b0eada48

openshift-ingress

kubelet

e2e-migrate-e8c645ee-gw-openshift-default-5b678599d8-f5rtx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-b0eada48-openshift-default-5d7bf7dd58

SuccessfulCreate

Created pod: e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

openshift-ingress

multus

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b0eada48

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b0eada48: serviceaccount "payload-processing-e2e-ait-b0eada48" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b0eada48

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b0eada48-57f5d65cbf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b0eada48-57f5d65cbf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b0eada48-57f5d65cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b0eada48: serviceaccount "payload-processing-e2e-ait-b0eada48" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b0eada48-57f5d65cbf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

openshift-ingress

kubelet

payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b0eada48-67bc5d8bd6-mk4pj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b0eada48-57f5d65cbf-kmg8h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-b0eada48-openshift-default-5d7bf7dd58-k6qgk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-d2dcf91d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d2dcf91d

openshift-ingress

deployment-controller

e2e-derive-d2dcf91d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-d2dcf91d-openshift-default-5bf588b496 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-d2dcf91d-openshift-default-5bf588b496

SuccessfulCreate

Created pod: e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

openshift-ingress

multus

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-d2dcf91d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-d2dcf91d-7c4b4469f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d2dcf91d: serviceaccount "payload-processing-e2e-derive-d2dcf91d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-d2dcf91d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-d2dcf91d-76974566f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d2dcf91d: serviceaccount "payload-processing-e2e-derive-d2dcf91d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l
(x2)

openshift-ingress

kubelet

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d2dcf91d-76974566f8-qxszj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-d2dcf91d-openshift-default-5bf588b496-h78c2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-d2dcf91d-7c4b4469f7-pmm9l

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-62de055a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-62de055a

openshift-ingress

deployment-controller

e2e-mt-62de055a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-62de055a-openshift-default-66b8c87c88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-62de055a-openshift-default-66b8c87c88

SuccessfulCreate

Created pod: e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

openshift-ingress

multus

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-62de055a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-62de055a-54f8d487d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-62de055a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-62de055a-648bd87c8f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-62de055a-54f8d487d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-62de055a-54f8d487d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-62de055a: serviceaccount "payload-processing-e2e-mt-62de055a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-62de055a-54f8d487d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-62de055a-648bd87c8f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-62de055a-648bd87c8f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-62de055a-648bd87c8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-62de055a: serviceaccount "payload-processing-e2e-mt-62de055a" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-bcb770-7c7bf5d4db-892gv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-bcb770-7fc555fbdc-6jxfg

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-bcb770-openshift-default-64fb9d4f9b-zrg8k

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-62de055a-648bd87c8f-xk9nb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-62de055a-54f8d487d6-2n5hw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-897f61-55bfc459bb-jx7rn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-897f61-7ccb4f565-qp6hv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-62de055a-openshift-default-66b8c87c88-qk9jl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-298125

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-298125

openshift-ingress

replicaset-controller

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd

SuccessfulCreate

Created pod: e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

openshift-ingress

deployment-controller

e2e-shared-a-w2-298125-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-298125-openshift-default-697b9bf4dd from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-897f61-openshift-default-757d7cbcd6-5qvch

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-298125: serviceaccount "payload-processing-e2e-shared-a-w2-298125" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-298125

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-298125-799bf4468c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-298125-799bf4468c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-298125: serviceaccount "payload-processing-e2e-shared-a-w2-298125" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-298125

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-298125-799bf4468c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-298125-799bf4468c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-880bee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-880bee

openshift-ingress

deployment-controller

e2e-shared-a-w1-880bee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-880bee-openshift-default-6db5cc6788 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788

SuccessfulCreate

Created pod: e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-880bee: serviceaccount "payload-processing-e2e-shared-a-w1-880bee" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a6d509

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a6d509

openshift-ingress

deployment-controller

e2e-shared-b-w2-a6d509-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4

SuccessfulCreate

Created pod: e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-880bee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-880bee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-880bee: serviceaccount "payload-processing-e2e-shared-a-w1-880bee" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a6d509

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a6d509: serviceaccount "payload-processing-e2e-shared-b-w2-a6d509" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a6d509: serviceaccount "payload-processing-e2e-shared-b-w2-a6d509" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a6d509

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w1-351045-openshift-default-54fcf577c4

SuccessfulCreate

Created pod: e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

openshift-ingress

deployment-controller

e2e-shared-b-w1-351045-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-351045-openshift-default-54fcf577c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-351045

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-351045

openshift-ingress

multus

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-351045

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-351045-7446cc65f7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-351045: serviceaccount "payload-processing-e2e-shared-b-w1-351045" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-351045-7446cc65f7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-351045-7446cc65f7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-351045-7446cc65f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-351045: serviceaccount "payload-processing-e2e-shared-b-w1-351045" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-351045

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Unhealthy

Readiness probe failed: Get "http://10.132.0.80:15021/healthz/ready": read tcp 10.132.0.2:39414->10.132.0.80:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

ProbeError

Readiness probe error: Get "http://10.132.0.80:15021/healthz/ready": read tcp 10.132.0.2:39414->10.132.0.80:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-25dc6358-openshift-default-6f9c6979dd

SuccessfulCreate

Created pod: e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

openshift-ingress

gateway_labeler_controller

e2e-mt-25dc6358

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-25dc6358

openshift-ingress

deployment-controller

e2e-mt-25dc6358-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-25dc6358-openshift-default-6f9c6979dd from 0 to 1

openshift-ingress

multus

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-25dc6358

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-25dc6358-7b4d74bb97 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25dc6358-7b4d74bb97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25dc6358-7b4d74bb97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-25dc6358-7b4d74bb97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25dc6358: serviceaccount "payload-processing-e2e-mt-25dc6358" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-25dc6358

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-25dc6358-b5c854bcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25dc6358: serviceaccount "payload-processing-e2e-mt-25dc6358" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

openshift-ingress

kubelet

payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-9d9f36-6f45dc89c4-69c4c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-9d9f36-7f5568cf95-8ts66

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-9d9f36-openshift-default-84fc56f996-lfm5z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25dc6358-b5c854bcd-2r74t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25dc6358-7b4d74bb97-w72ss

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-25dc6358

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-25dc6358: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-25dc6358": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-25dc6358, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c13129e2-887f-4758-980a-e2fa490bf7d9, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cc289c-8554c969bc-5q9nr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cc289c-579fb59b6b-9h7pt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-cc289c-openshift-default-5d8fc56c48-zj6gj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

Unhealthy

Readiness probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-25dc6358-openshift-default-6f9c6979dd-pnznn

ProbeError

Readiness probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-a-ce3141-openshift-default-b7764b4cd

SuccessfulCreate

Created pod: e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

openshift-ingress

deployment-controller

e2e-api-a-ce3141-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ce3141-openshift-default-b7764b4cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ce3141

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ce3141

openshift-ingress

multus

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ce3141-6f97b9cb57

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ce3141-6f97b9cb57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ce3141: serviceaccount "payload-processing-e2e-api-a-ce3141" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ce3141-6f97b9cb57

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ce3141

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ce3141: serviceaccount "payload-processing-e2e-api-a-ce3141" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ce3141

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ce3141-6f97b9cb57 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-02e2c9-openshift-default-774f47998d

SuccessfulCreate

Created pod: e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

openshift-ingress

deployment-controller

e2e-api-b-02e2c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-02e2c9-openshift-default-774f47998d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-02e2c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-02e2c9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-02e2c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-02e2c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-02e2c9-b4c4d5bc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-02e2c9: serviceaccount "payload-processing-e2e-api-b-02e2c9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-02e2c9: serviceaccount "payload-processing-e2e-api-b-02e2c9" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

ProbeError

Startup probe error: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

Unhealthy

Startup probe failed: Get "http://10.132.0.100:15021/healthz/ready": dial tcp 10.132.0.100:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ce3141-b45fdbcb6-c9mwd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ce3141-6f97b9cb57-hj8qk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-ce3141-openshift-default-b7764b4cd-sxq2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-02e2c9-b4c4d5bc5-qczqj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-02e2c9-dc4454bcd-kbklf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-02e2c9-openshift-default-774f47998d-jm9w5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-880bee-6656c4d966-mfxnr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-880bee-7c74fcfc4c-mzsgg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w1-880bee-openshift-default-6db5cc6788-w94c5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-351045-7446cc65f7-h8qbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-351045-5d5bddc8c8-8lxlj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w1-351045

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w1-351045: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w1-351045": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w1-351045, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 96f5d39c-b260-4cfa-80d8-7635916a9583, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-351045-openshift-default-54fcf577c4-8t7g4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0991d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0991d8

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-0991d8

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-0991d8-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-0991d8-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-ipp-a-0991d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd

SuccessfulCreate

Created pod: e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

openshift-ingress

multus

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0991d8-86f744cb4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0991d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0991d8-86f744cb4c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0991d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0991d8: serviceaccount "payload-processing-e2e-ipp-a-0991d8" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0991d8-86f744cb4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0991d8-86f744cb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0991d8: serviceaccount "payload-processing-e2e-ipp-a-0991d8" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

ProbeError

Readiness probe error: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Unhealthy

Readiness probe failed: Get "http://10.132.0.108:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d6246c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d6246c

openshift-ingress

deployment-controller

e2e-ipp-b-d6246c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d6246c-openshift-default-77ffd47cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-d6246c-openshift-default-77ffd47cd

SuccessfulCreate

Created pod: e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

openshift-ingress

multus

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d6246c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d6246c-567bd89dfc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d6246c: serviceaccount "payload-processing-e2e-ipp-b-d6246c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d6246c-567bd89dfc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d6246c-567bd89dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d6246c: serviceaccount "payload-processing-e2e-ipp-b-d6246c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d6246c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d6246c-567bd89dfc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

openshift-ingress

multus

payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

ProbeError

Startup probe error: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

Unhealthy

Startup probe failed: Get "http://10.132.0.109:15021/healthz/ready": dial tcp 10.132.0.109:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-5855d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-5855d4

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-5855d4-openshift-default-985786f94

SuccessfulCreate

Created pod: e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

openshift-ingress

deployment-controller

e2e-ipp-cleanup-5855d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-5855d4-openshift-default-985786f94 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

AddedInterface

Add eth0 [10.132.0.111/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5855d4: serviceaccount "payload-processing-e2e-ipp-cleanup-5855d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-5855d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-5855d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5855d4: serviceaccount "payload-processing-e2e-ipp-cleanup-5855d4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

ProbeError

Startup probe error: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Unhealthy

Startup probe failed: Get "http://10.132.0.111:15021/healthz/ready": dial tcp 10.132.0.111:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5855d4-578dcf9bb5-4ssgf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5855d4-d65c69958-jfl94

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-5855d4-openshift-default-985786f94-bj8hk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

Unhealthy

Readiness probe failed: dial tcp 10.134.0.78:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0991d8-86f744cb4c-km8j5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0991d8-b6bcc5d54-2fg47

Unhealthy

Readiness probe failed: dial tcp 10.134.0.79:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-0991d8-openshift-default-59cfc6dfbd-4wwp2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d6246c-5cd5c8fcd6-jctxg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d6246c-567bd89dfc-z4l57

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-d6246c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-d6246c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-d6246c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-d6246c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eb4f85ee-ad0e-468b-b5fb-ec6ac3b4b9cf, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-d6246c-openshift-default-77ffd47cd-wcqs9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-298125-5b87d487c4-fkjxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-298125-799bf4468c-k58dm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-298125-openshift-default-697b9bf4dd-85js4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a6d509-54694dd5f7-jdplb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a6d509-6b54475d66-2fwld

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-a6d509-openshift-default-84969b5cf4-dhb29

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: