Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj to ip-10-0-138-92.ec2.internal

openshift-ingress

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-migrate-e7b233dd-gw-openshift-default

ClusterIPNotAllocated

Cluster IP [IPv4]: 172.31.221.232 is not allocated; repairing

openshift-ingress

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc to ip-10-0-138-92.ec2.internal

openshift-ingress

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj to ip-10-0-131-250.ec2.internal

openshift-ingress

kube-auth-proxy-7f4d448d7f-58zzf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f4d448d7f-58zzf to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-db5d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-db5d6 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9 to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4 to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp to ip-10-0-131-250.ec2.internal

openshift-ingress

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-6fltp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-6fltp to ip-10-0-131-250.ec2.internal

openshift-ingress

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2 to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd to ip-10-0-138-92.ec2.internal

openshift-ingress

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw to ip-10-0-131-142.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-cfl9w

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfl9w to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx to ip-10-0-138-92.ec2.internal

openshift-ingress

kube-auth-proxy-7f4d448d7f-hj2jf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f4d448d7f-hj2jf to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794 to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp to ip-10-0-138-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq to ip-10-0-131-250.ec2.internal

openshift-ingress

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj to ip-10-0-138-92.ec2.internal

openshift-ingress

router-default-78695b457d-lfsxh

Scheduled

Successfully assigned openshift-ingress/router-default-78695b457d-lfsxh to ip-10-0-131-250.ec2.internal

openshift-ingress

router-default-78695b457d-lfsxh

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

istiod-openshift-gateway-5677ccb49b-4mscg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-4mscg to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-processing-e2e-autores-7a357a-6b64797769-b8h8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf to ip-10-0-131-250.ec2.internal

openshift-ingress

e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8 to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx to ip-10-0-138-92.ec2.internal

openshift-ingress

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

Scheduled

Successfully assigned openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn to ip-10-0-138-92.ec2.internal

openshift-ingress

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6 to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65 to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr to ip-10-0-138-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr to ip-10-0-131-142.ec2.internal

openshift-ingress

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q to ip-10-0-138-92.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs to ip-10-0-131-250.ec2.internal

openshift-ingress

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Scheduled

Successfully assigned openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj to ip-10-0-138-92.ec2.internal

openshift-ingress

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

Scheduled

Successfully assigned openshift-ingress/e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25 to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp to ip-10-0-131-250.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8 to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f to ip-10-0-131-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv to ip-10-0-131-142.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-78695b457d from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-78695b457d

FailedCreate

Error creating: pods "router-default-78695b457d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-78695b457d

FailedCreate

Error creating: pods "router-default-78695b457d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-78695b457d

SuccessfulCreate

Created pod: router-default-78695b457d-lfsxh
(x6)

openshift-ingress

kubelet

router-default-78695b457d-lfsxh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-78695b457d-lfsxh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-78695b457d-lfsxh

Started

Started container router

openshift-ingress

kubelet

router-default-78695b457d-lfsxh

Created

Created container: router

openshift-ingress

kubelet

router-default-78695b457d-lfsxh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-78695b457d-lfsxh

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7f4d448d7f

SuccessfulCreate

Created pod: kube-auth-proxy-7f4d448d7f-hj2jf

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7f4d448d7f from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7f4d448d7f

FailedCreate

Error creating: pods "kube-auth-proxy-7f4d448d7f-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7f4d448d7f

SuccessfulCreate

Created pod: kube-auth-proxy-7f4d448d7f-58zzf

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-hj2jf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-58zzf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7f4d448d7f-hj2jf

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7f4d448d7f-58zzf

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-cfl9w

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-cfl9w

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-58zzf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-58zzf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.742s (2.742s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-58zzf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-hj2jf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-hj2jf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.705s (2.705s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f4d448d7f-hj2jf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.692s (2.692s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.019s (3.019s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xdtqs

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-4mscg

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4mscg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-4mscg

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4mscg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.212s (2.212s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4mscg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4mscg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4mscg

ProbeError

Readiness probe error: Get "http://10.132.0.40:8080/ready": dial tcp 10.132.0.40:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4mscg

Unhealthy

Readiness probe failed: Get "http://10.132.0.40:8080/ready": dial tcp 10.132.0.40:8080: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-cfl9w

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfl9w

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-frjnr

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-frjnr

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.42s (3.42s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-6fltp

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-6fltp

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-db5d6

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6fltp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-db5d6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-db5d6

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6fltp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6fltp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6fltp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.682s (1.682s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-db5d6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.49s (4.49s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-db5d6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-db5d6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-frjnr

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-43eb2d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-43eb2d

openshift-ingress

multus

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8

SuccessfulCreate

Created pod: e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

openshift-ingress

replicaset-controller

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b

SuccessfulCreate

Created pod: e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

openshift-ingress

multus

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-43eb2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-43eb2d-openshift-default-cf78fd55b from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-ecd13e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ecd13e-openshift-default-77dbb58cb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ecd13e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ecd13e
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-43eb2d: serviceaccount "payload-processing-e2e-worker-w4-43eb2d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-43eb2d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-43eb2d: serviceaccount "payload-processing-e2e-worker-w4-43eb2d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-43eb2d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-43eb2d-687c76d8cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ecd13e: serviceaccount "payload-processing-e2e-inf-a-ecd13e" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ecd13e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ecd13e-6bc8846b59 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ecd13e-6bc8846b59

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ecd13e-6bc8846b59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ecd13e: serviceaccount "payload-processing-e2e-inf-a-ecd13e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ecd13e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ecd13e-6bc8846b59

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.617s (1.617s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4

SuccessfulCreate

Created pod: e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

openshift-ingress

deployment-controller

e2e-ait-c53eb05a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c53eb05a-openshift-default-7f5b9f77d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-c53eb05a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c53eb05a

openshift-ingress

deployment-controller

e2e-autores-7a357a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-7a357a-openshift-default-799c779cdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c53eb05a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c53eb05a-c95fbb747 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c53eb05a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-7a357a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-7a357a
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c53eb05a-c95fbb747

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c53eb05a-c95fbb747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c53eb05a: serviceaccount "payload-processing-e2e-ait-c53eb05a" not found

openshift-ingress

replicaset-controller

e2e-autores-7a357a-openshift-default-799c779cdb

SuccessfulCreate

Created pod: e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

openshift-ingress

kubelet

payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c53eb05a-c95fbb747

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

openshift-ingress

multus

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c53eb05a: serviceaccount "payload-processing-e2e-ait-c53eb05a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-7a357a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-7a357a-6b64797769 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7a357a-6b64797769

SuccessfulCreate

Created pod: payload-processing-e2e-autores-7a357a-6b64797769-b8h8h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7a357a-6b64797769

FailedCreate

Error creating: pods "payload-processing-e2e-autores-7a357a-6b64797769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7a357a: serviceaccount "payload-processing-e2e-autores-7a357a" not found

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7a357a-7b44ff74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-7a357a-7b44ff74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7a357a: serviceaccount "payload-processing-e2e-autores-7a357a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7a357a-7b44ff74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-7a357a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-7a357a-7b44ff74b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-7a357a-6b64797769-b8h8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-7a357a-6b64797769-b8h8h

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-autores-7a357a-6b64797769-b8h8h

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-autores-7a357a-6b64797769-b8h8h

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d

SuccessfulCreate

Created pod: e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

openshift-ingress

deployment-controller

e2e-inf-b-fe8eaa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fe8eaa-openshift-default-5cb856d54d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fe8eaa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fe8eaa

openshift-ingress

multus

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fe8eaa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fe8eaa-568f87ccc5 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fe8eaa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fe8eaa: serviceaccount "payload-processing-e2e-inf-b-fe8eaa" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fe8eaa: serviceaccount "payload-processing-e2e-inf-b-fe8eaa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-c53eb05a-c95fbb747-ct6dp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c53eb05a-85c9f88b54-nldvp

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-migrate-e7b233dd-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6

SuccessfulCreate

Created pod: e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

openshift-ingress

gateway_labeler_controller

e2e-migrate-e7b233dd-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e7b233dd-gw

openshift-ingress

multus

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e7b233dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e7b233dd: serviceaccount "payload-processing-e2e-migrate-e7b233dd" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e7b233dd: serviceaccount "payload-processing-e2e-migrate-e7b233dd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e7b233dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e7b233dd-65b9ff4f46 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-e7b233dd-65b9ff4f46-5t56v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e7b233dd-b7df67b9d-m5szr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-e7b233dd-gw-openshift-default-7957cd89f6-hwcmj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-8b70f171

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8b70f171

openshift-ingress

multus

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-8b70f171-openshift-default-7d4c4b9c96

SuccessfulCreate

Created pod: e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

openshift-ingress

deployment-controller

e2e-ait-8b70f171-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8b70f171-openshift-default-7d4c4b9c96 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8b70f171-7b95cb769f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8b70f171

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8b70f171-7b95cb769f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8b70f171-7b95cb769f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8b70f171-7b95cb769f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8b70f171: serviceaccount "payload-processing-e2e-ait-8b70f171" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8b70f171-7858689f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8b70f171-7858689f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8b70f171: serviceaccount "payload-processing-e2e-ait-8b70f171" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8b70f171-7858689f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8b70f171

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8b70f171-7858689f58 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-8b70f171-7b95cb769f-nxfcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8b70f171-7858689f58-4f4t8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-derive-d1d9fd16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-d1d9fd16-openshift-default-589678f58d from 0 to 1

openshift-ingress

kubelet

e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-d1d9fd16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-d1d9fd16

openshift-ingress

replicaset-controller

e2e-derive-d1d9fd16-openshift-default-589678f58d

SuccessfulCreate

Created pod: e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

openshift-ingress

multus

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7a357a-7b44ff74b-6qk4f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-7a357a-6b64797769-b8h8h

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d1d9fd16-bdfb99d85

SuccessfulCreate

Created pod: payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d1d9fd16: serviceaccount "payload-processing-e2e-derive-d1d9fd16" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-d1d9fd16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-d1d9fd16-bdfb99d85 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-d1d9fd16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-d1d9fd16-bdfb99d85

FailedCreate

Error creating: pods "payload-processing-e2e-derive-d1d9fd16-bdfb99d85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-d1d9fd16: serviceaccount "payload-processing-e2e-derive-d1d9fd16" not found

openshift-ingress

multus

payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-f631ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f631ee

openshift-ingress

deployment-controller

e2e-explicit-f631ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f631ee-openshift-default-7cff5f7f5b from 0 to 1

openshift-ingress

kubelet

e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-f631ee-openshift-default-7cff5f7f5b

SuccessfulCreate

Created pod: e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

openshift-ingress

multus

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f631ee-6559b7c7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f631ee-6559b7c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f631ee: serviceaccount "payload-processing-e2e-explicit-f631ee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f631ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f631ee-74796bf5d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f631ee: serviceaccount "payload-processing-e2e-explicit-f631ee" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f631ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f631ee-6559b7c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f631ee-6559b7c7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

openshift-ingress

kubelet

payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-d1d9fd16-8667c49dc8-ttvbt

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-d1d9fd16-openshift-default-589678f58d-7dt25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f631ee-6559b7c7-zmggw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f631ee-74796bf5d6-rsgxg

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-464e41e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-464e41e7

openshift-ingress

replicaset-controller

e2e-mt-464e41e7-openshift-default-5496fb896

SuccessfulCreate

Created pod: e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

openshift-ingress

deployment-controller

e2e-mt-464e41e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-464e41e7-openshift-default-5496fb896 from 0 to 1

openshift-ingress

multus

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-f8bdbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f8bdbb

openshift-ingress

replicaset-controller

e2e-noten-f8bdbb-openshift-default-5df74574f6

SuccessfulCreate

Created pod: e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

openshift-ingress

deployment-controller

e2e-noten-f8bdbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f8bdbb-openshift-default-5df74574f6 from 0 to 1

openshift-ingress

kubelet

e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-464e41e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-464e41e7-6f4bb77674 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-464e41e7-6f6d45f77

FailedCreate

Error creating: pods "payload-processing-e2e-mt-464e41e7-6f6d45f77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-464e41e7: serviceaccount "payload-processing-e2e-mt-464e41e7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-464e41e7-6f6d45f77

SuccessfulCreate

Created pod: payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

openshift-ingress

deployment-controller

payload-processing-e2e-mt-464e41e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-464e41e7-6f6d45f77 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-464e41e7: serviceaccount "payload-processing-e2e-mt-464e41e7" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": read tcp 10.134.0.2:52154->10.134.0.49:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": read tcp 10.134.0.2:52154->10.134.0.49:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-464e41e7-6f4bb77674-dvx65

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-464e41e7-6f6d45f77-dm8t2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f3d736

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f3d736

openshift-ingress

deployment-controller

e2e-shared-a-w2-f3d736-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6

SuccessfulCreate

Created pod: e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

openshift-ingress

multus

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f3d736

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736: serviceaccount "payload-processing-e2e-shared-a-w2-f3d736" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f3d736

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736: serviceaccount "payload-processing-e2e-shared-a-w2-f3d736" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-750c68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-750c68

openshift-ingress

deployment-controller

e2e-shared-b-w2-750c68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8

SuccessfulCreate

Created pod: e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

openshift-ingress

multus

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-750c68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-750c68-6b9b48496f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-750c68: serviceaccount "payload-processing-e2e-shared-b-w2-750c68" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-750c68: serviceaccount "payload-processing-e2e-shared-b-w2-750c68" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-750c68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ecd13e-6bc8846b59-vq8gl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-389cd1da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-389cd1da-openshift-default-866cdf9b48 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-389cd1da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-389cd1da
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-389cd1da-openshift-default-866cdf9b48

SuccessfulCreate

Created pod: e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

openshift-ingress

multus

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-389cd1da-7cddb7cbfc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

openshift-ingress

deployment-controller

payload-processing-e2e-mt-389cd1da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-389cd1da-7cddb7cbfc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-389cd1da-7cddb7cbfc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-389cd1da-7cddb7cbfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-389cd1da: serviceaccount "payload-processing-e2e-mt-389cd1da" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-389cd1da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-389cd1da: serviceaccount "payload-processing-e2e-mt-389cd1da" not found

openshift-ingress

multus

payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fe8eaa-568f87ccc5-5z4qp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fe8eaa-76889d76c4-mphkg

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-6b5d89

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-6b5d89

openshift-ingress

kubelet

e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-6b5d89-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956

SuccessfulCreate

Created pod: e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

openshift-ingress

multus

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.754s (2.754s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-6b5d89

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89: serviceaccount "payload-processing-e2e-shared-a-w3-6b5d89" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-6b5d89

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89: serviceaccount "payload-processing-e2e-shared-a-w3-6b5d89" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-7cf6be-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7cf6be-openshift-default-76d8888876 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7cf6be

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7cf6be

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876

SuccessfulCreate

Created pod: e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

openshift-ingress

multus

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7cf6be

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7cf6be: serviceaccount "payload-processing-e2e-shared-b-w3-7cf6be" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7cf6be

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7cf6be: serviceaccount "payload-processing-e2e-shared-b-w3-7cf6be" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-389cd1da-7cddb7cbfc-x2nn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-389cd1da-openshift-default-866cdf9b48-w4wjs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-e1ed02-openshift-default-6974d5668b

SuccessfulCreate

Created pod: e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

openshift-ingress

deployment-controller

e2e-api-a-e1ed02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e1ed02-openshift-default-6974d5668b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-e1ed02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e1ed02

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e1ed02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e1ed02-6b97c85bc7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e1ed02-6b97c85bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e1ed02: serviceaccount "payload-processing-e2e-api-a-e1ed02" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e1ed02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e1ed02-6b97c85bc7 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e1ed02: serviceaccount "payload-processing-e2e-api-a-e1ed02" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e1ed02-6b97c85bc7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

openshift-ingress

kubelet

payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-d907ff-openshift-default-5b66f7b58

SuccessfulCreate

Created pod: e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

openshift-ingress

deployment-controller

e2e-api-b-d907ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d907ff-openshift-default-5b66f7b58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-d907ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d907ff
(x2)

openshift-ingress

kubelet

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

Started

Started container istio-proxy

openshift-ingress

multus

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d907ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d907ff-bf4d4c997 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d907ff-75b7557474

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d907ff-75b7557474-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d907ff: serviceaccount "payload-processing-e2e-api-b-d907ff" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d907ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d907ff-75b7557474 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d907ff-bf4d4c997

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d907ff-bf4d4c997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d907ff: serviceaccount "payload-processing-e2e-api-b-d907ff" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d907ff-bf4d4c997

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d907ff-75b7557474

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-e1ed02-openshift-default-6974d5668b-2hdxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-43eb2d-687c76d8cf-z5qlq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-43eb2d-86669b4c74-2psmf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d907ff-75b7557474-tql5j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-d907ff

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-d907ff: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-d907ff": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-d907ff, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db5e5cda-b287-492d-9de8-5fd00ff8f43b, UID in object meta:

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-d907ff-openshift-default-5b66f7b58-nm794

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-f3d736

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-f3d736": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2fd50391-24b3-49e9-85d9-9c772ae0a92f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-750c68-6b9b48496f-wkb4k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-750c68-openshift-default-bc9b8bbf8-n9vtj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b

SuccessfulCreate

Created pod: e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8a6cf7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8a6cf7

openshift-ingress

deployment-controller

e2e-ipp-a-8a6cf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8a6cf7-openshift-default-c99fd787b from 0 to 1

openshift-ingress

multus

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8a6cf7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8a6cf7-69689f8675

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8a6cf7-69689f8675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7: serviceaccount "payload-processing-e2e-ipp-a-8a6cf7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8a6cf7-69689f8675

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7: serviceaccount "payload-processing-e2e-ipp-a-8a6cf7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8a6cf7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8a6cf7-69689f8675 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6

SuccessfulCreate

Created pod: e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

openshift-ingress

deployment-controller

e2e-ipp-b-32ea4d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-32ea4d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-32ea4d

openshift-ingress

multus

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-32ea4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-32ea4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-32ea4d-69858dc589 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-32ea4d-69858dc589

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-32ea4d: serviceaccount "payload-processing-e2e-ipp-b-32ea4d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-32ea4d-69858dc589

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-32ea4d-69858dc589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-32ea4d: serviceaccount "payload-processing-e2e-ipp-b-32ea4d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

ProbeError

Readiness probe error: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Unhealthy

Readiness probe failed: Get "http://10.133.0.89:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2e28ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2e28ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2e28ff

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2e28ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff: serviceaccount "payload-processing-e2e-ipp-cleanup-2e28ff" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2e28ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff: serviceaccount "payload-processing-e2e-ipp-cleanup-2e28ff" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-2e28ff

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-2e28ff": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6504b7b3-aa19-4a2e-9306-a528ebbdb492, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-2e28ff-openshift-default-7cb9675d5d-g5vtz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-8a6cf7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-8a6cf7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-8a6cf7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-8a6cf7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 705ecf23-a889-4fd9-9fed-ea87590dffa1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8a6cf7-bdf474ddb-85l7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-32ea4d-7cc4848ff4-j4fwv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-32ea4d-openshift-default-5cdf75fdb6-cwmwq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-6b5d89-openshift-default-c6c54d956-nwww4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7cf6be-59fdf7cbf5-fv8wn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7cf6be-7f5595974-mqgd8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503