Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j to ip-10-0-143-224.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-077e89-5955d94c99-bthnl to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-82f543-openshift-default-746d47c544-g7vn6 to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt to ip-10-0-143-224.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65 to ip-10-0-143-224.ec2.internal

openshift-ingress

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk to ip-10-0-143-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-08bc01-85748b97-zrx24

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-08bc01-85748b97-zrx24 to ip-10-0-143-241.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5 to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7 to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-zdk65

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zdk65 to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq to ip-10-0-143-224.ec2.internal

openshift-ingress

router-default-5c4444dc76-c2dcn

Scheduled

Successfully assigned openshift-ingress/router-default-5c4444dc76-c2dcn to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5 to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq to ip-10-0-143-224.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4 to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs to ip-10-0-143-241.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fstnx to ip-10-0-143-224.ec2.internal

openshift-ingress

payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw to ip-10-0-135-122.ec2.internal

openshift-ingress

kube-auth-proxy-758cfc744b-w7r8z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-758cfc744b-w7r8z to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd to ip-10-0-143-224.ec2.internal

openshift-ingress

kube-auth-proxy-758cfc744b-627r6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-758cfc744b-627r6 to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-qzrnd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-qzrnd to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5 to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn to ip-10-0-143-224.ec2.internal

openshift-ingress

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw to ip-10-0-135-122.ec2.internal

openshift-ingress

router-default-5c4444dc76-c2dcn

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74 to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Scheduled

Successfully assigned openshift-ingress/e2e-autores-812760-openshift-default-5cd46b49c8-725xh to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g to ip-10-0-135-122.ec2.internal

openshift-ingress

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5 to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr to ip-10-0-135-122.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-qqz4k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-qqz4k to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-21117b-747669564f-vgc5h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-21117b-747669564f-vgc5h to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2 to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd to ip-10-0-135-122.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-rfx7d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rfx7d to ip-10-0-135-122.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7 to ip-10-0-143-241.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5c4444dc76 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-5c4444dc76

FailedCreate

Error creating: pods "router-default-5c4444dc76-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5c4444dc76

FailedCreate

Error creating: pods "router-default-5c4444dc76-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5c4444dc76

SuccessfulCreate

Created pod: router-default-5c4444dc76-c2dcn
(x6)

openshift-ingress

kubelet

router-default-5c4444dc76-c2dcn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5c4444dc76-c2dcn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5c4444dc76-c2dcn

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5c4444dc76-c2dcn

Created

Created container: router

openshift-ingress

kubelet

router-default-5c4444dc76-c2dcn

Started

Started container router

openshift-ingress

kubelet

router-default-5c4444dc76-c2dcn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-758cfc744b

FailedCreate

Error creating: pods "kube-auth-proxy-758cfc744b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-758cfc744b from 0 to 2

openshift-ingress

multus

kube-auth-proxy-758cfc744b-w7r8z

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-w7r8z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-758cfc744b

SuccessfulCreate

Created pod: kube-auth-proxy-758cfc744b-627r6

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-627r6

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-758cfc744b

SuccessfulCreate

Created pod: kube-auth-proxy-758cfc744b-w7r8z

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-627r6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-758cfc744b-627r6

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-rfx7d

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-rfx7d

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-w7r8z

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-w7r8z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.925s (2.925s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-w7r8z

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-627r6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.74s (2.74s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-627r6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-758cfc744b-627r6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.561s (2.561s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.687s (2.687s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-t5vb5

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-qqz4k

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-qqz4k

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qqz4k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qqz4k

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qqz4k

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qqz4k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.005s (3.005s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-rfx7d

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-rfx7d

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-fstnx

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-fstnx

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.61s (2.61s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zdk65

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-qzrnd

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-zdk65

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdk65

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-qzrnd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qzrnd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qzrnd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.862s (1.862s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdk65

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.826s (1.826s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdk65

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qzrnd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zdk65

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qzrnd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fstnx

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-21117b-openshift-default-6778ddc5fd

SuccessfulCreate

Created pod: e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

openshift-ingress

deployment-controller

e2e-inf-a-21117b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-21117b-openshift-default-6778ddc5fd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-21117b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-21117b

openshift-ingress

multus

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-21117b-747669564f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-21117b-747669564f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-21117b: serviceaccount "payload-processing-e2e-inf-a-21117b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-21117b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-21117b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-21117b-747669564f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-21117b-747669564f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-21117b-747669564f-vgc5h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-21117b: serviceaccount "payload-processing-e2e-inf-a-21117b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

openshift-ingress

multus

payload-processing-e2e-inf-a-21117b-747669564f-vgc5h

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21117b-747669564f-vgc5h

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21117b-747669564f-vgc5h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21117b-747669564f-vgc5h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-87ac1d4f-openshift-default-846b75b67b

SuccessfulCreate

Created pod: e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

openshift-ingress

gateway_labeler_controller

e2e-ait-87ac1d4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-87ac1d4f

openshift-ingress

multus

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-87ac1d4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-87ac1d4f-openshift-default-846b75b67b from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-812760-openshift-default-5cd46b49c8

SuccessfulCreate

Created pod: e2e-autores-812760-openshift-default-5cd46b49c8-725xh

openshift-ingress

deployment-controller

e2e-autores-812760-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-812760-openshift-default-5cd46b49c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-812760

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-812760

openshift-ingress

multus

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

openshift-ingress

deployment-controller

payload-processing-e2e-ait-87ac1d4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-87ac1d4f-76c5fff4f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-87ac1d4f: serviceaccount "payload-processing-e2e-ait-87ac1d4f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-87ac1d4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-87ac1d4f: serviceaccount "payload-processing-e2e-ait-87ac1d4f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-812760

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-812760-9d7fb49cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-812760

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-812760-54fdb888f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-812760-9d7fb49cc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

openshift-ingress

multus

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-812760-54fdb888f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-812760-9d7fb49cc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-812760-9d7fb49cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-812760: serviceaccount "payload-processing-e2e-autores-812760" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-812760-54fdb888f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-812760-54fdb888f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-812760: serviceaccount "payload-processing-e2e-autores-812760" not found

openshift-ingress

multus

payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

e2e-inf-b-4defd2-openshift-default-5df668f74b

SuccessfulCreate

Created pod: e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

openshift-ingress

deployment-controller

e2e-inf-b-4defd2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-4defd2-openshift-default-5df668f74b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-4defd2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-4defd2

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

ProbeError

Readiness probe error: Get "http://10.133.0.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Unhealthy

Readiness probe failed: Get "http://10.133.0.26:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.722s (2.722s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4defd2: serviceaccount "payload-processing-e2e-inf-b-4defd2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-4defd2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-4defd2-6c85c758d5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Unhealthy

Startup probe failed: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

ProbeError

Startup probe error: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4defd2-6c85c758d5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-4defd2-6c85c758d5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-4defd2-6c85c758d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-4defd2: serviceaccount "payload-processing-e2e-inf-b-4defd2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-4defd2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Unhealthy

Readiness probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

ProbeError

Readiness probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-87ac1d4f-76c5fff4f9-hjw2d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-87ac1d4f-5f9db94cd-4cxg2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-87ac1d4f-openshift-default-846b75b67b-hztsq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8

SuccessfulCreate

Created pod: e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

openshift-ingress

gateway_labeler_controller

e2e-migrate-25e8b2a0-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-25e8b2a0-gw

openshift-ingress

deployment-controller

e2e-migrate-25e8b2a0-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-25e8b2a0: serviceaccount "payload-processing-e2e-migrate-25e8b2a0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-25e8b2a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-25e8b2a0: serviceaccount "payload-processing-e2e-migrate-25e8b2a0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-25e8b2a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-25e8b2a0-6db7c58d94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

openshift-ingress

kubelet

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-migrate-25e8b2a0-6db7c58d94-slqk5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25e8b2a0-557b5446c8-sn9q4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-25e8b2a0-gw-openshift-default-778b98bd8-ltff5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-4275e4e8-openshift-default-85888f76d8

SuccessfulCreate

Created pod: e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

openshift-ingress

gateway_labeler_controller

e2e-ait-4275e4e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4275e4e8

openshift-ingress

deployment-controller

e2e-ait-4275e4e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4275e4e8-openshift-default-85888f76d8 from 0 to 1

openshift-ingress

multus

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4275e4e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4275e4e8-547cb69fc5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4275e4e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4275e4e8-f89b996b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4275e4e8-f89b996b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4275e4e8-f89b996b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4275e4e8: serviceaccount "payload-processing-e2e-ait-4275e4e8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4275e4e8-547cb69fc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

openshift-ingress

multus

payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4275e4e8-547cb69fc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4275e4e8-547cb69fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4275e4e8: serviceaccount "payload-processing-e2e-ait-4275e4e8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4275e4e8-f89b996b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

openshift-ingress

multus

payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-812760-54fdb888f8-psnfk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4275e4e8-f89b996b-rhbrm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-812760-9d7fb49cc-cpwvw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4275e4e8-547cb69fc5-wwdxr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-f4c2073a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f4c2073a

openshift-ingress

deployment-controller

e2e-derive-f4c2073a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f4c2073a-openshift-default-68767df888 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-f4c2073a-openshift-default-68767df888

SuccessfulCreate

Created pod: e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

openshift-ingress

multus

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-4275e4e8-openshift-default-85888f76d8-mptnk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f4c2073a: serviceaccount "payload-processing-e2e-derive-f4c2073a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f4c2073a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f4c2073a-584b7876f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f4c2073a-584b7876f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f4c2073a: serviceaccount "payload-processing-e2e-derive-f4c2073a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f4c2073a-584b7876f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f4c2073a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f4c2073a-584b7876f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f4c2073a-86cbffcbc8-krgdm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f4c2073a-584b7876f-7rgxp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-f4c2073a-openshift-default-68767df888-fgl6j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-812760-openshift-default-5cd46b49c8-725xh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-08bc01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-08bc01

openshift-ingress

deployment-controller

e2e-explicit-08bc01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-08bc01-openshift-default-57d6dbdd9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-08bc01-openshift-default-57d6dbdd9b

SuccessfulCreate

Created pod: e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

openshift-ingress

multus

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-08bc01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-08bc01-9dd57f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-08bc01-9dd57f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-08bc01-9dd57f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-08bc01-9dd57f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-08bc01: serviceaccount "payload-processing-e2e-explicit-08bc01" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-08bc01-85748b97

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-08bc01-85748b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-08bc01: serviceaccount "payload-processing-e2e-explicit-08bc01" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-08bc01-85748b97

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-08bc01-85748b97-zrx24

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-08bc01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-08bc01-85748b97 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-08bc01-85748b97-zrx24

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-08bc01-85748b97-zrx24

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-08bc01-85748b97-zrx24

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-08bc01-85748b97-zrx24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-36f068b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-36f068b3

openshift-ingress

deployment-controller

e2e-mt-36f068b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-36f068b3-openshift-default-74c4bd4568 from 0 to 1

openshift-ingress

multus

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-mt-36f068b3

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-36f068b3-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-36f068b3-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-mt-36f068b3-openshift-default-74c4bd4568

SuccessfulCreate

Created pod: e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-36f068b3-74b948cd58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-36f068b3-74b948cd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-36f068b3: serviceaccount "payload-processing-e2e-mt-36f068b3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-36f068b3-74b948cd58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

openshift-ingress

deployment-controller

payload-processing-e2e-mt-36f068b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-36f068b3-7db479b649 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-36f068b3-7db479b649

SuccessfulCreate

Created pod: payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-36f068b3-7db479b649

FailedCreate

Error creating: pods "payload-processing-e2e-mt-36f068b3-7db479b649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-36f068b3: serviceaccount "payload-processing-e2e-mt-36f068b3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-36f068b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-36f068b3-74b948cd58 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-08bc01-9dd57f8-6bl6w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-08bc01-85748b97-zrx24

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-82f543

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-82f543

openshift-ingress

deployment-controller

e2e-noten-82f543-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-82f543-openshift-default-746d47c544 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-82f543-openshift-default-746d47c544

SuccessfulCreate

Created pod: e2e-noten-82f543-openshift-default-746d47c544-g7vn6

openshift-ingress

kubelet

e2e-explicit-08bc01-openshift-default-57d6dbdd9b-msgvd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-36f068b3-74b948cd58-5psjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-36f068b3-7db479b649-zp4dg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-82f543-openshift-default-746d47c544-g7vn6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-36f068b3-openshift-default-74c4bd4568-ktkvg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-dc2ebb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-dc2ebb

openshift-ingress

deployment-controller

e2e-shared-a-w2-dc2ebb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94

SuccessfulCreate

Created pod: e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-dc2ebb

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-dc2ebb-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-dc2ebb-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-dc2ebb: serviceaccount "payload-processing-e2e-shared-a-w2-dc2ebb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-dc2ebb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-dc2ebb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-dc2ebb: serviceaccount "payload-processing-e2e-shared-a-w2-dc2ebb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-21117b-747669564f-vgc5h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-21117b-7dc6d694f4-92rtx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-21117b-openshift-default-6778ddc5fd-ph5lh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-47e11e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-47e11e

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-47e11e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb

SuccessfulCreate

Created pod: e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

openshift-ingress

multus

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-47e11e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-47e11e: serviceaccount "payload-processing-e2e-shared-b-w2-47e11e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-47e11e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-47e11e: serviceaccount "payload-processing-e2e-shared-b-w2-47e11e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-4defd2-cd6d8df4-nvts5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-4defd2-6c85c758d5-4thdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-166b94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-166b94-openshift-default-86cff64888 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-166b94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-166b94

openshift-ingress

replicaset-controller

e2e-shared-a-w3-166b94-openshift-default-86cff64888

SuccessfulCreate

Created pod: e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-4defd2-openshift-default-5df668f74b-cz77c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-166b94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-166b94: serviceaccount "payload-processing-e2e-shared-a-w3-166b94" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-166b94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-166b94: serviceaccount "payload-processing-e2e-shared-a-w3-166b94" not found
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Started

Started container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-57f5cbb5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-57f5cbb5

openshift-ingress

multus

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-57f5cbb5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-57f5cbb5-openshift-default-56cc4f979b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-57f5cbb5-openshift-default-56cc4f979b

SuccessfulCreate

Created pod: e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": read tcp 10.134.0.2:55576->10.134.0.60:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": read tcp 10.134.0.2:55576->10.134.0.60:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-57f5cbb5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-57f5cbb5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-57f5cbb5-59cf4bdb69 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-57f5cbb5: serviceaccount "payload-processing-e2e-mt-57f5cbb5" not found

openshift-ingress

multus

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

openshift-ingress

kubelet

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-57f5cbb5: serviceaccount "payload-processing-e2e-mt-57f5cbb5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4

SuccessfulCreate

Created pod: e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4101f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4101f2

openshift-ingress

deployment-controller

e2e-shared-b-w3-4101f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4101f2: serviceaccount "payload-processing-e2e-shared-b-w3-4101f2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4101f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4101f2-6b58849f97 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4101f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4101f2: serviceaccount "payload-processing-e2e-shared-b-w3-4101f2" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57f5cbb5-74d856fbcd-dcm2c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-57f5cbb5-59cf4bdb69-lln4r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-57f5cbb5-openshift-default-56cc4f979b-g4knr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-077e89-openshift-default-6cfc94b6bd

SuccessfulCreate

Created pod: e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

openshift-ingress

deployment-controller

e2e-api-a-077e89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-077e89-openshift-default-6cfc94b6bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-077e89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-077e89

openshift-ingress

multus

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-077e89-5955d94c99

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-077e89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-077e89-5955d94c99 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-077e89: serviceaccount "payload-processing-e2e-api-a-077e89" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-077e89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-077e89-6dbf65bc86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-077e89-5955d94c99

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-077e89-5955d94c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-077e89: serviceaccount "payload-processing-e2e-api-a-077e89" not found

openshift-ingress

multus

payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-06f7dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-06f7dc-openshift-default-5d7798bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-06f7dc-openshift-default-5d7798bb

SuccessfulCreate

Created pod: e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

openshift-ingress

gateway_labeler_controller

e2e-api-b-06f7dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-06f7dc

openshift-ingress

multus

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-06f7dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-06f7dc-6bc585d6b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-06f7dc-6bc585d6b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-06f7dc-6bc585d6b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-06f7dc: serviceaccount "payload-processing-e2e-api-b-06f7dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-06f7dc-6bc585d6b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-06f7dc: serviceaccount "payload-processing-e2e-api-b-06f7dc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-06f7dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-06f7dc-6f9698df4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-077e89

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-077e89: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-077e89": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-077e89, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8e6b8fdf-b459-43a5-850e-9b820bc6ed66, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-077e89-6dbf65bc86-55phq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-077e89-5955d94c99-bthnl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-077e89-openshift-default-6cfc94b6bd-2p4gs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-06f7dc-6bc585d6b9-f9fhr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-06f7dc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-06f7dc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-06f7dc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-06f7dc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: dbbdc7ca-aa5b-471e-833b-85a159013a3c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-06f7dc-6f9698df4-6cnz7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-06f7dc-openshift-default-5d7798bb-m5snn

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-dc2ebb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc2ebb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-dc2ebb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc2ebb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3bebc9de-20f1-43e4-a9ee-1c1eeb4979af, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-dc2ebb-67b865dc4b-8mxrw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-dc2ebb-586f8b489-g2cft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-dc2ebb-openshift-default-675674bf94-kcnxt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-47e11e-58f867dc5c-p8x9k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-47e11e-d7c64bff8-tg7mw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-47e11e-openshift-default-9974d5fbb-57jjq

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-a-868e40-openshift-default-794b74b896

SuccessfulCreate

Created pod: e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

openshift-ingress

deployment-controller

e2e-ipp-a-868e40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-868e40-openshift-default-794b74b896 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-868e40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-868e40

openshift-ingress

multus

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-868e40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-868e40-6566bf5479

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-868e40-6566bf5479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-868e40: serviceaccount "payload-processing-e2e-ipp-a-868e40" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-868e40: serviceaccount "payload-processing-e2e-ipp-a-868e40" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-868e40-6566bf5479

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-868e40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-868e40-6566bf5479 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-697f19-openshift-default-5cdcd594fb

SuccessfulCreate

Created pod: e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

openshift-ingress

deployment-controller

e2e-ipp-b-697f19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-697f19-openshift-default-5cdcd594fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-697f19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-697f19

openshift-ingress

multus

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-697f19: serviceaccount "payload-processing-e2e-ipp-b-697f19" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-697f19-75ccbbbf5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-697f19-75ccbbbf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-697f19: serviceaccount "payload-processing-e2e-ipp-b-697f19" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-697f19-75ccbbbf5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-697f19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-697f19-75ccbbbf5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-697f19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-697f19-5cff56b958 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-dd5d0a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-dd5d0a-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-dd5d0a-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-ipp-cleanup-dd5d0a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-dd5d0a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-dd5d0a

openshift-ingress

multus

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-dd5d0a: serviceaccount "payload-processing-e2e-ipp-cleanup-dd5d0a" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-dd5d0a: serviceaccount "payload-processing-e2e-ipp-cleanup-dd5d0a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-dd5d0a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-dd5d0a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dd5d0a-dbf695ff4-c4b74

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dd5d0a-66556f4cc9-f2llz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-dd5d0a-openshift-default-b6bfcc8f6-tw75m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-868e40-5df55fbdc8-fq7pr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-868e40-6566bf5479-xdsf7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-868e40-openshift-default-794b74b896-7lr4w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-697f19-75ccbbbf5-6rkqd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-697f19-5cff56b958-ks67g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-697f19-openshift-default-5cdcd594fb-9vfcf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-166b94-77f5bccd78-t7f5f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-166b94-6f87f9bfff-7c97h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-166b94-openshift-default-86cff64888-bwl65

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4101f2-79d5f69998-67znp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4101f2-6b58849f97-ttw8x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-4101f2-openshift-default-6d456cc6c4-mlfdb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: