Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz to ip-10-0-130-195.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc28v55 to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8 to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26 to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn to ip-10-0-140-30.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287 to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9 to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Scheduled

Successfully assigned openshift-ingress/e2e-mt-34523cde-openshift-default-67c485458d-m4t8x to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4 to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-52h68

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-52h68 to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7 to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-26814939-openshift-default-5f6898cb96-gppjg to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4 to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7v7hl

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7v7hl to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4 to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-ait-26814939-784f95c975-cgtc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-26814939-784f95c975-cgtc9 to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w to ip-10-0-140-30.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-t9t74

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t9t74 to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4 to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5 to ip-10-0-138-179.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-lb4tw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-lb4tw to ip-10-0-130-195.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vw9wc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vw9wc to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf to ip-10-0-130-195.ec2.internal

openshift-ingress

kube-auth-proxy-7f78fb9f44-czvpr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f78fb9f44-czvpr to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-processing-e2e-derive-285c6871-99659647c-s8p22

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-285c6871-99659647c-s8p22 to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98 to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv to ip-10-0-140-30.ec2.internal

openshift-ingress

router-default-78556b97cb-rt5r7

Scheduled

Successfully assigned openshift-ingress/router-default-78556b97cb-rt5r7 to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-57c530-openshift-default-db4c98744-4lhn4 to ip-10-0-130-195.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6 to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl to ip-10-0-138-179.ec2.internal

openshift-ingress

kube-auth-proxy-7f78fb9f44-7c4gt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f78fb9f44-7c4gt to ip-10-0-138-179.ec2.internal

openshift-ingress

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45 to ip-10-0-130-195.ec2.internal

openshift-ingress

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj to ip-10-0-140-30.ec2.internal

openshift-ingress

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

Scheduled

Successfully assigned openshift-ingress/e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5 to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4 to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz to ip-10-0-140-30.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq to ip-10-0-138-179.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j to ip-10-0-138-179.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-78556b97cb from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-78556b97cb

FailedCreate

Error creating: pods "router-default-78556b97cb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-78556b97cb

FailedCreate

Error creating: pods "router-default-78556b97cb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-78556b97cb

SuccessfulCreate

Created pod: router-default-78556b97cb-rt5r7
(x6)

openshift-ingress

kubelet

router-default-78556b97cb-rt5r7

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-78556b97cb-rt5r7

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-78556b97cb-rt5r7

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-78556b97cb-rt5r7

Created

Created container: router

openshift-ingress

kubelet

router-default-78556b97cb-rt5r7

Started

Started container router

openshift-ingress

kubelet

router-default-78556b97cb-rt5r7

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-7f78fb9f44

SuccessfulCreate

Created pod: kube-auth-proxy-7f78fb9f44-7c4gt

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7f78fb9f44 from 0 to 2
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-7f78fb9f44

FailedCreate

Error creating: pods "kube-auth-proxy-7f78fb9f44-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7f78fb9f44

SuccessfulCreate

Created pod: kube-auth-proxy-7f78fb9f44-czvpr

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-7c4gt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vw9wc

openshift-ingress

multus

kube-auth-proxy-7f78fb9f44-7c4gt

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7f78fb9f44-czvpr

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-czvpr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vw9wc

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-czvpr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.07s (3.07s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-7c4gt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-7c4gt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-czvpr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-7c4gt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.293s (3.293s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f78fb9f44-czvpr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.366s (4.366s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bc28v55

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.342s (3.342s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-rz7rk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.883s (2.883s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bc28v55

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

ProbeError

Startup probe error: Get "http://10.132.0.21:15021/healthz/ready": dial tcp 10.132.0.21:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc28v55

Unhealthy

Startup probe failed: Get "http://10.132.0.21:15021/healthz/ready": dial tcp 10.132.0.21:15021: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-lb4tw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lb4tw

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-lb4tw

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lb4tw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lb4tw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lb4tw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lb4tw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vw9wc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vw9wc

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-t9t74

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-t9t74

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7v7hl

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-52h68
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-52h68

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7v7hl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-7v7hl

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-52h68

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-52h68

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-52h68

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.579s (1.579s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-52h68

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7v7hl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7v7hl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7v7hl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.621s (1.621s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-t9t74

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a28c9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a28c9f

openshift-ingress

multus

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-a28c9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a28c9f-openshift-default-6686cbc66d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-a28c9f-openshift-default-6686cbc66d

SuccessfulCreate

Created pod: e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a28c9f: serviceaccount "payload-processing-e2e-inf-a-a28c9f" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a28c9f: serviceaccount "payload-processing-e2e-inf-a-a28c9f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a28c9f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a28c9f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-eda9e4-openshift-default-686577ddb

SuccessfulCreate

Created pod: e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-autores-eda9e4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-eda9e4-openshift-default-686577ddb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-eda9e4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-eda9e4

openshift-ingress

multus

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-d6904f79-openshift-default-5f84b67ff8

SuccessfulCreate

Created pod: e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

openshift-ingress

gateway_labeler_controller

e2e-ait-d6904f79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d6904f79

openshift-ingress

deployment-controller

e2e-ait-d6904f79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d6904f79-openshift-default-5f84b67ff8 from 0 to 1

openshift-ingress

multus

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-eda9e4-77b57bf45c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

openshift-ingress

deployment-controller

payload-processing-e2e-autores-eda9e4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-eda9e4-77b57bf45c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-eda9e4-77b57bf45c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-eda9e4-77b57bf45c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-eda9e4: serviceaccount "payload-processing-e2e-autores-eda9e4" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-eda9e4-695967bd58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-eda9e4-695967bd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-eda9e4: serviceaccount "payload-processing-e2e-autores-eda9e4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-eda9e4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-eda9e4-695967bd58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-eda9e4-695967bd58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

openshift-ingress

kubelet

payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d6904f79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d6904f79-86fdb86df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d6904f79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d6904f79: serviceaccount "payload-processing-e2e-ait-d6904f79" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d6904f79-86fdb86df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d6904f79-86fdb86df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d6904f79-86fdb86df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d6904f79: serviceaccount "payload-processing-e2e-ait-d6904f79" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fca08f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fca08f

openshift-ingress

deployment-controller

e2e-inf-b-fca08f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fca08f-openshift-default-55695f6bd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-fca08f-openshift-default-55695f6bd8

SuccessfulCreate

Created pod: e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

openshift-ingress

multus

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fca08f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fca08f-79546d6f8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fca08f-79546d6f8c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fca08f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fca08f: serviceaccount "payload-processing-e2e-inf-b-fca08f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fca08f-79546d6f8c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fca08f-79546d6f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fca08f: serviceaccount "payload-processing-e2e-inf-b-fca08f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ait-d6904f79-86fdb86df-cnkrc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d6904f79-85c7f8f7c8-sxn7p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d6904f79-openshift-default-5f84b67ff8-px8br

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-migrate-52e7067f-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-52e7067f-gw

openshift-ingress

deployment-controller

e2e-migrate-52e7067f-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4

SuccessfulCreate

Created pod: e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls
(x6)

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

multus

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-52e7067f: serviceaccount "payload-processing-e2e-migrate-52e7067f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-52e7067f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-52e7067f-674857fb4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-52e7067f-f84f59c74

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-52e7067f-f84f59c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-52e7067f: serviceaccount "payload-processing-e2e-migrate-52e7067f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-52e7067f-f84f59c74

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-52e7067f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-52e7067f-f84f59c74 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

openshift-ingress

multus

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

ProbeError

Readiness probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Unhealthy

Readiness probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-52e7067f-674857fb4b-8lb5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-52e7067f-gw-openshift-default-bffc4bdb4-gx6ls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-52e7067f-f84f59c74-9l4mq

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-26814939

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-26814939

openshift-ingress

deployment-controller

e2e-ait-26814939-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-26814939-openshift-default-5f6898cb96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-26814939-openshift-default-5f6898cb96

SuccessfulCreate

Created pod: e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

openshift-ingress

multus

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-26814939

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-26814939-784f95c975 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-26814939: serviceaccount "payload-processing-e2e-ait-26814939" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-26814939-784f95c975

SuccessfulCreate

Created pod: payload-processing-e2e-ait-26814939-784f95c975-cgtc9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-26814939

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-26814939-784f95c975

FailedCreate

Error creating: pods "payload-processing-e2e-ait-26814939-784f95c975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-26814939: serviceaccount "payload-processing-e2e-ait-26814939" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-26814939-784f95c975-cgtc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-26814939-784f95c975-cgtc9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-26814939-784f95c975-cgtc9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-26814939-784f95c975-cgtc9

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-26814939-784f95c975-cgtc9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26814939-6b4cdc4d6b-gbx9h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-26814939-openshift-default-5f6898cb96-gppjg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-285c6871

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-285c6871

openshift-ingress

deployment-controller

e2e-derive-285c6871-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-285c6871-openshift-default-78bdc7c7cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-285c6871-openshift-default-78bdc7c7cb

SuccessfulCreate

Created pod: e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

openshift-ingress

multus

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-285c6871

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-285c6871-99659647c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-285c6871-fb984d6cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-285c6871-99659647c-s8p22

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-285c6871-99659647c-s8p22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-285c6871-99659647c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-285c6871-99659647c-s8p22

openshift-ingress

multus

payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-285c6871

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-285c6871-fb984d6cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-285c6871-99659647c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-285c6871-99659647c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-285c6871: serviceaccount "payload-processing-e2e-derive-285c6871" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-285c6871-fb984d6cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-285c6871-fb984d6cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-285c6871: serviceaccount "payload-processing-e2e-derive-285c6871" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-285c6871-99659647c-s8p22

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-285c6871-99659647c-s8p22

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-eda9e4-695967bd58-t2g26

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-eda9e4-77b57bf45c-sqcz5

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-eda9e4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-eda9e4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-eda9e4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-eda9e4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f581343d-2c6c-4632-8eb4-a1dd2c8ff7e5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-285c6871-fb984d6cd-7j9lz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-285c6871-99659647c-s8p22

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-285c6871-openshift-default-78bdc7c7cb-74rhp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-eda9e4-openshift-default-686577ddb-sz7v5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-57c530

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-57c530

openshift-ingress

deployment-controller

e2e-explicit-57c530-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-57c530-openshift-default-db4c98744 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-57c530-openshift-default-db4c98744

SuccessfulCreate

Created pod: e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

openshift-ingress

multus

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-57c530

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-57c530-7765788dfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-57c530-7765788dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-57c530-7765788dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-57c530-7765788dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-57c530: serviceaccount "payload-processing-e2e-explicit-57c530" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-57c530-6695dfdc4f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-57c530-6695dfdc4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-57c530: serviceaccount "payload-processing-e2e-explicit-57c530" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-57c530-6695dfdc4f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-57c530

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-57c530-6695dfdc4f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-57c530

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-57c530: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-57c530": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-57c530, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9439ae07-b914-4daf-bd1b-dec0af62f537, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-57c530-6695dfdc4f-2ch98

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-57c530-7765788dfd-hwwtn

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-noten-9cca98-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-9cca98-openshift-default-564bf4ccd from 0 to 1

openshift-ingress

kubelet

e2e-explicit-57c530-openshift-default-db4c98744-4lhn4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-9cca98

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-9cca98

openshift-ingress

replicaset-controller

e2e-noten-9cca98-openshift-default-564bf4ccd

SuccessfulCreate

Created pod: e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

openshift-ingress

multus

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-34523cde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-34523cde-openshift-default-67c485458d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-34523cde-openshift-default-67c485458d

SuccessfulCreate

Created pod: e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

openshift-ingress

gateway_labeler_controller

e2e-mt-34523cde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-34523cde

openshift-ingress

multus

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a28c9f-5b6c74bcbc-j7hwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a28c9f-5f66dfcbf4-cd287

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-34523cde-85746cb8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-34523cde-85746cb8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-34523cde: serviceaccount "payload-processing-e2e-mt-34523cde" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-34523cde-656f8bb88f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-34523cde-656f8bb88f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-34523cde: serviceaccount "payload-processing-e2e-mt-34523cde" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-34523cde-656f8bb88f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-34523cde-85746cb8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-34523cde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-34523cde-85746cb8b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-34523cde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-34523cde-656f8bb88f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-a28c9f-openshift-default-6686cbc66d-xd54s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fca08f-7d8f9d6f9d-9ckl9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fca08f-79546d6f8c-ddzbl

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-9cca98-openshift-default-564bf4ccd-2s6xq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-fca08f-openshift-default-55695f6bd8-j49nt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d

SuccessfulCreate

Created pod: e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

openshift-ingress

deployment-controller

e2e-shared-a-w3-cc6708-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-cc6708

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-cc6708

openshift-ingress

multus

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-cc6708

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cc6708: serviceaccount "payload-processing-e2e-shared-a-w3-cc6708" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cc6708: serviceaccount "payload-processing-e2e-shared-a-w3-cc6708" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-cc6708

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:36392->10.132.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": read tcp 10.132.0.2:36392->10.132.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-34523cde-85746cb8b-z54nv

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-34523cde-656f8bb88f-mr8xv

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-9342ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-9342ed

openshift-ingress

replicaset-controller

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4

SuccessfulCreate

Created pod: e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-34523cde-openshift-default-67c485458d-m4t8x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-b-w3-9342ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-9342ed-openshift-default-b985b9d4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-9342ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-9342ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9342ed: serviceaccount "payload-processing-e2e-shared-b-w3-9342ed" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-9342ed: serviceaccount "payload-processing-e2e-shared-b-w3-9342ed" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86

SuccessfulCreate

Created pod: e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-772e41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-772e41

openshift-ingress

deployment-controller

e2e-shared-a-w2-772e41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-772e41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-772e41-c65794cd9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-772e41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-772e41-665579d78 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-772e41-c65794cd9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-772e41-c65794cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-772e41: serviceaccount "payload-processing-e2e-shared-a-w2-772e41" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-772e41-c65794cd9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-772e41: serviceaccount "payload-processing-e2e-shared-a-w2-772e41" not found

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:40648->10.133.0.62:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": read tcp 10.133.0.2:40648->10.133.0.62:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f8229c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f8229c

openshift-ingress

deployment-controller

e2e-shared-b-w2-f8229c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f8229c-openshift-default-6b78857b64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64

SuccessfulCreate

Created pod: e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-f8229c

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-f8229c-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-f8229c-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f8229c: serviceaccount "payload-processing-e2e-shared-b-w2-f8229c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f8229c: serviceaccount "payload-processing-e2e-shared-b-w2-f8229c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f8229c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f8229c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f8229c-8b74878d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-354ac6fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-354ac6fe-openshift-default-75b86d5c76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-354ac6fe-openshift-default-75b86d5c76

SuccessfulCreate

Created pod: e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

openshift-ingress

multus

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-354ac6fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-354ac6fe

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-354ac6fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-354ac6fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-354ac6fe-584dcccccc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-354ac6fe: serviceaccount "payload-processing-e2e-mt-354ac6fe" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-354ac6fe-584dcccccc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-354ac6fe-584dcccccc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-354ac6fe-584dcccccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-354ac6fe: serviceaccount "payload-processing-e2e-mt-354ac6fe" not found

openshift-ingress

multus

payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-354ac6fe-584dcccccc-sz2zv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-354ac6fe-7f4f64f686-nm2mh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-354ac6fe-openshift-default-75b86d5c76-92jmg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-bf30f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-bf30f8

openshift-ingress

replicaset-controller

e2e-api-a-bf30f8-openshift-default-6f9768dbb

SuccessfulCreate

Created pod: e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

openshift-ingress

deployment-controller

e2e-api-a-bf30f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-bf30f8-openshift-default-6f9768dbb from 0 to 1

openshift-ingress

multus

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bf30f8: serviceaccount "payload-processing-e2e-api-a-bf30f8" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bf30f8-54b84448fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-bf30f8-54b84448fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bf30f8: serviceaccount "payload-processing-e2e-api-a-bf30f8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bf30f8-54b84448fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-bf30f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-bf30f8-54b84448fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-bf30f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-599baf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-599baf

openshift-ingress

multus

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-599baf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-599baf-openshift-default-8b5fc85cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-599baf-openshift-default-8b5fc85cd

SuccessfulCreate

Created pod: e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-599baf-77b55f68f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-599baf-6db59cc666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-599baf-6db59cc666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-599baf: serviceaccount "payload-processing-e2e-api-b-599baf" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-599baf-6db59cc666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-599baf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-599baf-6db59cc666 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-599baf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-599baf-77b55f68f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-599baf-77b55f68f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-599baf-77b55f68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-599baf: serviceaccount "payload-processing-e2e-api-b-599baf" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bf30f8-79c46ddc6b-kh2fl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-bf30f8-54b84448fc-7m4pg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-bf30f8-openshift-default-6f9768dbb-lshjx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-599baf-6db59cc666-vcts8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-599baf-77b55f68f-qpnf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-599baf-openshift-default-8b5fc85cd-cwj45

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-772e41-665579d78-8zst4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-772e41-c65794cd9-jjrdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-772e41-openshift-default-cb8dd9b86-brqd4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-fdc690-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-fdc690-openshift-default-6dcb6b4486 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486

SuccessfulCreate

Created pod: e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-fdc690

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-fdc690

openshift-ingress

multus

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f8229c-77b67bb94b-krzmq

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-f8229c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8229c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-f8229c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f8229c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4f0eb599-a680-45bd-9e5e-4d85c2db20d3, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f8229c-8b74878d7-z82qp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-fdc690

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fdc690: serviceaccount "payload-processing-e2e-ipp-a-fdc690" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-fdc690: serviceaccount "payload-processing-e2e-ipp-a-fdc690" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-fdc690

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b from 0 to 1

openshift-ingress

kubelet

e2e-shared-b-w2-f8229c-openshift-default-6b78857b64-r44sf

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-7a5a85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7a5a85-openshift-default-57d998b6c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4

SuccessfulCreate

Created pod: e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7a5a85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7a5a85

openshift-ingress

multus

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7a5a85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7a5a85: serviceaccount "payload-processing-e2e-ipp-b-7a5a85" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7a5a85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7a5a85: serviceaccount "payload-processing-e2e-ipp-b-7a5a85" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

openshift-ingress

deployment-controller

e2e-ipp-cleanup-84b423-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-84b423

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-84b423

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-84b423-7f58594789

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-84b423

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-84b423-7f58594789 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-84b423: serviceaccount "payload-processing-e2e-ipp-cleanup-84b423" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-84b423

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-84b423-7f58594789

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-84b423-7f58594789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-84b423: serviceaccount "payload-processing-e2e-ipp-cleanup-84b423" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-84b423

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-84b423: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-84b423": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-84b423, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9a61ba31-4688-4667-83e7-53fe8ba174ad, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-84b423-7f58594789-8pr5j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-84b423-6dfdfcb5c8-xw5j7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-84b423-openshift-default-6668f75ff4-cxmpz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-fdc690-6fcc6c49cc-nr6c4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-fdc690-848fb6554b-8lbfs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-fdc690-openshift-default-6dcb6b4486-dmsrb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7a5a85-86d55bdcdf-c5bfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7a5a85-699b88f8bb-dzrsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-7a5a85-openshift-default-57d998b6c4-s5tg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc6708-7679d85c98-nz6rx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc6708-87cc5b7df-n9pb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-cc6708-openshift-default-6779bb4d7d-t7s5w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-9342ed-55d6769f7d-7t6ww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-9342ed-69ff7d58f5-29zpz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-9342ed-openshift-default-b985b9d4-bgqmj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503