Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9 to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl to ip-10-0-133-73.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcngcqq to ip-10-0-134-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6 to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-l46wn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-l46wn to ip-10-0-133-73.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-v5cfk to ip-10-0-134-164.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5 to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5 to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74 to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-588a26-openshift-default-8574784b4-gvcsg to ip-10-0-133-73.ec2.internal

openshift-ingress

kube-auth-proxy-6445dbdc5b-gkbm6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6445dbdc5b-gkbm6 to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn to ip-10-0-134-164.ec2.internal

openshift-ingress

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ef119741-openshift-default-7c785c776-9hpnn to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-508c5fc8-5876c794b-56548 to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9 to ip-10-0-134-164.ec2.internal

openshift-ingress

kube-auth-proxy-6445dbdc5b-5z7fn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6445dbdc5b-5z7fn to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj to ip-10-0-134-164.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-kqzxb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-kqzxb to ip-10-0-143-82.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-l45df

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-l45df to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k to ip-10-0-134-164.ec2.internal

openshift-ingress

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5 to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr to ip-10-0-134-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-fa486478-openshift-default-55699657d4-85xmt to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9 to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7 to ip-10-0-134-164.ec2.internal

openshift-ingress

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7 to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr to ip-10-0-134-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-autores-15da7b-688d5f8989-58lng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-15da7b-688d5f8989-58lng to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-804072-5b6788555f-hlvd8 to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Scheduled

Successfully assigned openshift-ingress/e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp to ip-10-0-134-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

Scheduled

Successfully assigned openshift-ingress/e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d to ip-10-0-134-164.ec2.internal

openshift-ingress

router-default-675764b9db-82s2n

Scheduled

Successfully assigned openshift-ingress/router-default-675764b9db-82s2n to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49 to ip-10-0-143-82.ec2.internal

openshift-ingress

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb to ip-10-0-134-164.ec2.internal

openshift-ingress

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr to ip-10-0-134-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2 to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx to ip-10-0-134-164.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-bdkgr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-bdkgr to ip-10-0-133-73.ec2.internal

openshift-ingress

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd to ip-10-0-133-73.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ef119741-58f684c-m9947

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ef119741-58f684c-m9947 to ip-10-0-143-82.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5 to ip-10-0-133-73.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-675764b9db from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x6)

openshift-ingress

replicaset-controller

router-default-675764b9db

FailedCreate

Error creating: pods "router-default-675764b9db-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-675764b9db

FailedCreate

Error creating: pods "router-default-675764b9db-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-675764b9db

SuccessfulCreate

Created pod: router-default-675764b9db-82s2n
(x6)

openshift-ingress

kubelet

router-default-675764b9db-82s2n

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-675764b9db-82s2n

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-675764b9db-82s2n

Started

Started container router

openshift-ingress

kubelet

router-default-675764b9db-82s2n

Created

Created container: router

openshift-ingress

kubelet

router-default-675764b9db-82s2n

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-675764b9db-82s2n

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-6445dbdc5b

FailedCreate

Error creating: pods "kube-auth-proxy-6445dbdc5b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-gkbm6

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-5z7fn

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6445dbdc5b

SuccessfulCreate

Created pod: kube-auth-proxy-6445dbdc5b-5z7fn

openshift-ingress

replicaset-controller

kube-auth-proxy-6445dbdc5b

SuccessfulCreate

Created pod: kube-auth-proxy-6445dbdc5b-gkbm6

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6445dbdc5b from 0 to 2

openshift-ingress

multus

kube-auth-proxy-6445dbdc5b-5z7fn

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-5z7fn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6445dbdc5b-gkbm6

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-gkbm6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-kqzxb

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-kqzxb

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-5z7fn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-5z7fn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-gkbm6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.985s (2.985s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-5z7fn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.975s (2.975s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-gkbm6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6445dbdc5b-gkbm6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.719s (3.719s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.644s (2.644s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.42s (2.42s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qxff

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcngcqq
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

ProbeError

Startup probe error: Get "http://10.134.0.24:15021/healthz/ready": dial tcp 10.134.0.24:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Unhealthy

Startup probe failed: Get "http://10.134.0.24:15021/healthz/ready": dial tcp 10.134.0.24:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcngcqq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-l45df

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-l45df

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l45df

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l45df

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l45df

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l45df

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.575s (2.575s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-kqzxb

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-kqzxb

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-v5cfk

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-l46wn

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-bdkgr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-l46wn

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-bdkgr

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-l46wn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bdkgr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-l46wn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-l46wn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.432s (1.432s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-l46wn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bdkgr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.307s (1.307s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bdkgr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bdkgr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

ProbeError

Readiness probe error: Get "http://10.134.0.32:15021/healthz/ready": read tcp 10.134.0.2:52428->10.134.0.32:15021: read: connection reset by peer body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

Unhealthy

Readiness probe failed: Get "http://10.134.0.32:15021/healthz/ready": read tcp 10.134.0.2:52428->10.134.0.32:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-v5cfk

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-48adf5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-48adf5

openshift-ingress

deployment-controller

e2e-inf-a-48adf5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-48adf5-openshift-default-c6c9b67bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6

SuccessfulCreate

Created pod: e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

openshift-ingress

deployment-controller

e2e-worker-w0-a21a40-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a21a40-openshift-default-59bc8b5db6 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-f27ea8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-f27ea8

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a21a40

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a21a40

openshift-ingress

replicaset-controller

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb

SuccessfulCreate

Created pod: e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

openshift-ingress

multus

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-f27ea8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-f27ea8-openshift-default-55779f9bdb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-48adf5-openshift-default-c6c9b67bb

SuccessfulCreate

Created pod: e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

openshift-ingress

multus

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f27ea8-5d69d75685

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-f27ea8-5d69d75685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f27ea8: serviceaccount "payload-processing-e2e-worker-w4-f27ea8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-f27ea8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-f27ea8-5d69d75685

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-f27ea8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-f27ea8-5d69d75685 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-f27ea8-5d69d75685-xgtc5

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-f27ea8: serviceaccount "payload-processing-e2e-worker-w4-f27ea8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-f27ea8-6b5d6fcf94-f5cm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-48adf5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-48adf5-6b465d865c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-48adf5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-48adf5-6f4db764db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48adf5: serviceaccount "payload-processing-e2e-inf-a-48adf5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-48adf5-6b465d865c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-48adf5-6b465d865c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-48adf5: serviceaccount "payload-processing-e2e-inf-a-48adf5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-48adf5-6b465d865c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-48adf5-6b465d865c-fvrjd

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-48adf5-6f4db764db-v5tz6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a21a40

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a21a40-7d5576cd45 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-15da7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-15da7b

openshift-ingress

deployment-controller

e2e-autores-15da7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-15da7b-openshift-default-7d4b8d687d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-15da7b-openshift-default-7d4b8d687d

SuccessfulCreate

Created pod: e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a21a40-7d5576cd45

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a21a40: serviceaccount "payload-processing-e2e-worker-w0-a21a40" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a21a40-7d5576cd45

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a21a40-7d5576cd45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a21a40: serviceaccount "payload-processing-e2e-worker-w0-a21a40" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a21a40

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a21a40-7d5576cd45-bqjwl

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-ef119741

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ef119741

openshift-ingress

replicaset-controller

e2e-ait-ef119741-openshift-default-7c785c776

SuccessfulCreate

Created pod: e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

openshift-ingress

deployment-controller

e2e-ait-ef119741-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ef119741-openshift-default-7c785c776 from 0 to 1

openshift-ingress

multus

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.386s (1.386s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a21a40-998b8fd58-h6v49

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ef119741-58f684c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ef119741-58f684c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ef119741: serviceaccount "payload-processing-e2e-ait-ef119741" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ef119741-7db79cd8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ef119741-7db79cd8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ef119741: serviceaccount "payload-processing-e2e-ait-ef119741" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ef119741-7db79cd8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ef119741

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ef119741-7db79cd8db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ef119741-58f684c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ef119741-58f684c-m9947

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ef119741

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ef119741-58f684c from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-ef119741-58f684c-m9947

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ef119741-58f684c-m9947

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ef119741-58f684c-m9947

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ef119741-58f684c-m9947

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-15da7b-688d5f8989

FailedCreate

Error creating: pods "payload-processing-e2e-autores-15da7b-688d5f8989-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-15da7b: serviceaccount "payload-processing-e2e-autores-15da7b" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-15da7b: serviceaccount "payload-processing-e2e-autores-15da7b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-15da7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-15da7b-688d5f8989 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-15da7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-15da7b-688d5f8989

SuccessfulCreate

Created pod: payload-processing-e2e-autores-15da7b-688d5f8989-58lng

openshift-ingress

deployment-controller

e2e-inf-b-c71ad7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-c71ad7-openshift-default-59c66547b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-15da7b-688d5f8989-58lng

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-inf-b-c71ad7-openshift-default-59c66547b6

SuccessfulCreate

Created pod: e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

openshift-ingress

kubelet

payload-processing-e2e-autores-15da7b-688d5f8989-58lng

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-c71ad7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-c71ad7

openshift-ingress

kubelet

payload-processing-e2e-autores-15da7b-688d5f8989-58lng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-15da7b-688d5f8989-58lng

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Unhealthy

Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

ProbeError

Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c71ad7: serviceaccount "payload-processing-e2e-inf-b-c71ad7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-c71ad7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-c71ad7-649796db5d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-c71ad7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-c71ad7-545fb8f657 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c71ad7-545fb8f657

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-c71ad7-545fb8f657

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-c71ad7-545fb8f657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-c71ad7: serviceaccount "payload-processing-e2e-inf-b-c71ad7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-c71ad7-649796db5d-ghsff

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-c71ad7-545fb8f657-s7qc9

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-ef119741-58f684c-m9947

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef119741-7db79cd8db-jhrrx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-508c5fc8-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-508c5fc8-gw

openshift-ingress

multus

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d

SuccessfulCreate

Created pod: e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

openshift-ingress

deployment-controller

e2e-migrate-508c5fc8-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d from 0 to 1

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-ef119741-openshift-default-7c785c776-9hpnn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-508c5fc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-508c5fc8-5876c794b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-508c5fc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-508c5fc8-5876c794b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-508c5fc8-5876c794b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-508c5fc8: serviceaccount "payload-processing-e2e-migrate-508c5fc8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-508c5fc8: serviceaccount "payload-processing-e2e-migrate-508c5fc8" not found

openshift-ingress

multus

payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-508c5fc8-5876c794b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-508c5fc8-5876c794b-56548

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-508c5fc8-589f4667c8-p9rcg

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-508c5fc8-gw-openshift-default-d9f66878d-hrlj7

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-fa486478-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-fa486478-openshift-default-55699657d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-fa486478

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fa486478

openshift-ingress

replicaset-controller

e2e-ait-fa486478-openshift-default-55699657d4

SuccessfulCreate

Created pod: e2e-ait-fa486478-openshift-default-55699657d4-85xmt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-fa486478

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-fa486478-54f6467c6c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fa486478-554cf74ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-fa486478

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-fa486478-554cf74ccd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fa486478-54f6467c6c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fa486478-54f6467c6c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-fa486478-54f6467c6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fa486478: serviceaccount "payload-processing-e2e-ait-fa486478" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fa486478-554cf74ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-fa486478-554cf74ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fa486478: serviceaccount "payload-processing-e2e-ait-fa486478" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-fa486478-54f6467c6c-4wxj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fa486478-554cf74ccd-c77bf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-fa486478-openshift-default-55699657d4-85xmt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-9615f1d6-openshift-default-7b658d9c6

SuccessfulCreate

Created pod: e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

openshift-ingress

gateway_labeler_controller

e2e-derive-9615f1d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9615f1d6

openshift-ingress

deployment-controller

e2e-derive-9615f1d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-9615f1d6-openshift-default-7b658d9c6 from 0 to 1

openshift-ingress

multus

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9615f1d6: serviceaccount "payload-processing-e2e-derive-9615f1d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-9615f1d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9615f1d6-674c9f8949

SuccessfulCreate

Created pod: payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

openshift-ingress

deployment-controller

payload-processing-e2e-derive-9615f1d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-9615f1d6-674c9f8949 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9615f1d6-674c9f8949

FailedCreate

Error creating: pods "payload-processing-e2e-derive-9615f1d6-674c9f8949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9615f1d6: serviceaccount "payload-processing-e2e-derive-9615f1d6" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-15da7b-688d5f8989-58lng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-15da7b-6cfdbcd9cd-7xqbq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9615f1d6-674c9f8949-7vfwt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9615f1d6-55c7d6b89d-nmf6t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-derive-9615f1d6-openshift-default-7b658d9c6-jvszn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-explicit-588a26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-588a26

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-588a26

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-588a26-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-588a26-authn-ssl" already exists

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-15da7b-openshift-default-7d4b8d687d-r7gdp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-588a26-openshift-default-8574784b4

SuccessfulCreate

Created pod: e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

openshift-ingress

deployment-controller

e2e-explicit-588a26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-588a26-openshift-default-8574784b4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-588a26-6ffff64f5c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-588a26-6ffff64f5c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-588a26-6ffff64f5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-588a26: serviceaccount "payload-processing-e2e-explicit-588a26" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-588a26-b699d86f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-588a26-b699d86f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-588a26: serviceaccount "payload-processing-e2e-explicit-588a26" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-588a26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-588a26-6ffff64f5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-588a26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-588a26-b699d86f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-588a26-b699d86f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

openshift-ingress

multus

payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-588a26

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-588a26: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-588a26": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-588a26, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b45c6f2f-0b26-46c7-bf4f-96566d4ef84d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-588a26-b699d86f8-q2rgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-588a26-6ffff64f5c-26xzb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-588a26-openshift-default-8574784b4-gvcsg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-3ec3e3-openshift-default-65c696cf4d

SuccessfulCreate

Created pod: e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

openshift-ingress

deployment-controller

e2e-noten-3ec3e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-3ec3e3-openshift-default-65c696cf4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-3ec3e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-3ec3e3

openshift-ingress

kubelet

e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-3ec3e3-openshift-default-65c696cf4d-x9v2d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-b97e79df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b97e79df-openshift-default-674c78cfc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-b97e79df-openshift-default-674c78cfc6

SuccessfulCreate

Created pod: e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

openshift-ingress

gateway_labeler_controller

e2e-mt-b97e79df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b97e79df

openshift-ingress

multus

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b97e79df-84d6cb6c49

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b97e79df-84d6cb6c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b97e79df: serviceaccount "payload-processing-e2e-mt-b97e79df" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b97e79df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b97e79df-5657d8c98b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b97e79df: serviceaccount "payload-processing-e2e-mt-b97e79df" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b97e79df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b97e79df-84d6cb6c49 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b97e79df-84d6cb6c49

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

openshift-ingress

multus

payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-b97e79df-84d6cb6c49-vhsl5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b97e79df-5657d8c98b-xkl7w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b97e79df-openshift-default-674c78cfc6-jvjcd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b0514e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b0514e

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b

SuccessfulCreate

Created pod: e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

openshift-ingress

deployment-controller

e2e-shared-a-w2-b0514e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b0514e-openshift-default-79b785f87b from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b0514e: serviceaccount "payload-processing-e2e-shared-a-w2-b0514e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b0514e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b0514e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b0514e: serviceaccount "payload-processing-e2e-shared-a-w2-b0514e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

Unhealthy

Startup probe failed: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

ProbeError

Startup probe error: Get "http://10.133.0.83:15021/healthz/ready": dial tcp 10.133.0.83:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-7841d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb

SuccessfulCreate

Created pod: e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7841d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7841d9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7841d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7841d9-8f947fcc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7841d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7841d9: serviceaccount "payload-processing-e2e-shared-b-w2-7841d9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7841d9: serviceaccount "payload-processing-e2e-shared-b-w2-7841d9" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-4a235ace-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4a235ace-openshift-default-788d5dddd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-4a235ace

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4a235ace

openshift-ingress

replicaset-controller

e2e-mt-4a235ace-openshift-default-788d5dddd4

SuccessfulCreate

Created pod: e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

openshift-ingress

multus

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4a235ace-cdf76899c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4a235ace-cdf76899c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4a235ace: serviceaccount "payload-processing-e2e-mt-4a235ace" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4a235ace

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4a235ace-54765658b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4a235ace-54765658b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4a235ace

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4a235ace-cdf76899c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4a235ace-54765658b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4a235ace-54765658b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4a235ace: serviceaccount "payload-processing-e2e-mt-4a235ace" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4a235ace-cdf76899c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-48adf5-openshift-default-c6c9b67bb-8csr9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-4a235ace-cdf76899c-jq88b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4a235ace-54765658b6-hj7dr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-7e7bb4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-7e7bb4

openshift-ingress

deployment-controller

e2e-shared-a-w3-7e7bb4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58

SuccessfulCreate

Created pod: e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

openshift-ingress

multus

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-c71ad7-openshift-default-59c66547b6-tzgxj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7e7bb4: serviceaccount "payload-processing-e2e-shared-a-w3-7e7bb4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-7e7bb4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7e7bb4: serviceaccount "payload-processing-e2e-shared-a-w3-7e7bb4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-7e7bb4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-8c3cdf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-8c3cdf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-8c3cdf

openshift-ingress

replicaset-controller

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584

SuccessfulCreate

Created pod: e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4a235ace-openshift-default-788d5dddd4-l2mfm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-8c3cdf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-8c3cdf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8c3cdf: serviceaccount "payload-processing-e2e-shared-b-w3-8c3cdf" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8c3cdf: serviceaccount "payload-processing-e2e-shared-b-w3-8c3cdf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-a21a40-openshift-default-59bc8b5db6-hmjv5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-f27ea8-openshift-default-55779f9bdb-hhrqr

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-api-a-744b19

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-a-744b19-authn-ssl: envoyfilters.networking.istio.io "e2e-api-a-744b19-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-api-a-744b19-openshift-default-6f7c94df4

SuccessfulCreate

Created pod: e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

openshift-ingress

deployment-controller

e2e-api-a-744b19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-744b19-openshift-default-6f7c94df4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-744b19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-744b19

openshift-ingress

multus

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-744b19: serviceaccount "payload-processing-e2e-api-a-744b19" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-744b19-84c99747b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-744b19-84c99747b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-744b19-84c99747b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-744b19: serviceaccount "payload-processing-e2e-api-a-744b19" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-744b19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-744b19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-744b19-84c99747b9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-804072-openshift-default-6797dc6bf6

SuccessfulCreate

Created pod: e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

openshift-ingress

gateway_labeler_controller

e2e-api-b-804072

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-804072

openshift-ingress

deployment-controller

e2e-api-b-804072-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-804072-openshift-default-6797dc6bf6 from 0 to 1

openshift-ingress

multus

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-804072

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-804072-5b6788555f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-804072-5b6788555f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-804072

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-804072-657c5d5994 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-804072-5b6788555f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-804072-5b6788555f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-804072: serviceaccount "payload-processing-e2e-api-b-804072" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-804072-657c5d5994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-804072-657c5d5994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-804072-657c5d5994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-804072: serviceaccount "payload-processing-e2e-api-b-804072" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-744b19-84c99747b9-p6vhl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-744b19-7cd6c4dd78-7cjsd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-744b19-openshift-default-6f7c94df4-f8h2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-804072-657c5d5994-t2gbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-804072-5b6788555f-hlvd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-804072-openshift-default-6797dc6bf6-bnsbb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b0514e-85f6f4765d-j5mf7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b0514e-7bd76cc595-m25rz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-b0514e-openshift-default-79b785f87b-lrpzd

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-7841d9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7841d9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-7841d9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7841d9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6e1072d9-d5b0-4ca7-ae7d-3c73696c61d1, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7841d9-8f947fcc-f5w74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7841d9-65c5fdcf5d-w5stl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7841d9-openshift-default-99cf7ddbb-bf5vr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7e7bb4-f88699b8f-5cvt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7e7bb4-85b4976754-jthsk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-7e7bb4-openshift-default-7768964f58-l5fqx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8c3cdf-5c9f8cd8db-zksqn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8c3cdf-8f9d7694c-g4mpj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-8c3cdf-openshift-default-59f5b5d584-d9wkr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503