Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5 to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm to ip-10-0-135-167.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5 to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb to ip-10-0-128-237.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4grfw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4grfw to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-v8vwn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-v8vwn to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57 to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4 to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8 to ip-10-0-135-167.ec2.internal

openshift-ingress

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm to ip-10-0-135-167.ec2.internal

openshift-ingress

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-104872-8546c44b65-mbr27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-104872-8546c44b65-mbr27 to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29 to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6 to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-76smh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-76smh to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-api-b-a93550-openshift-default-784758bccb-5598g

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-a93550-openshift-default-784758bccb-5598g to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx to ip-10-0-128-237.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759 to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h to ip-10-0-140-215.ec2.internal

openshift-ingress

router-default-89b8b6fbd-68pzd

Scheduled

Successfully assigned openshift-ingress/router-default-89b8b6fbd-68pzd to ip-10-0-128-237.ec2.internal

openshift-ingress

router-default-89b8b6fbd-68pzd

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg to ip-10-0-128-237.ec2.internal

openshift-ingress

payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl to ip-10-0-140-215.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-tdmbx

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-tdmbx to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws to ip-10-0-135-167.ec2.internal

openshift-ingress

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Scheduled

Successfully assigned openshift-ingress/e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn to ip-10-0-140-215.ec2.internal

openshift-ingress

kube-auth-proxy-64d8557cb6-c5r7j

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-64d8557cb6-c5r7j to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr to ip-10-0-140-215.ec2.internal

openshift-ingress

kube-auth-proxy-64d8557cb6-fwh9z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-64d8557cb6-fwh9z to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74 to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf to ip-10-0-135-167.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-r2wv5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r2wv5 to ip-10-0-128-237.ec2.internal

openshift-ingress

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w to ip-10-0-140-215.ec2.internal

openshift-ingress

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Scheduled

Successfully assigned openshift-ingress/e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2 to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72 to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4 to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw to ip-10-0-135-167.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n to ip-10-0-140-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4 to ip-10-0-135-167.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-89b8b6fbd from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-89b8b6fbd

FailedCreate

Error creating: pods "router-default-89b8b6fbd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-89b8b6fbd

FailedCreate

Error creating: pods "router-default-89b8b6fbd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-89b8b6fbd

SuccessfulCreate

Created pod: router-default-89b8b6fbd-68pzd
(x6)

openshift-ingress

kubelet

router-default-89b8b6fbd-68pzd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-89b8b6fbd-68pzd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-89b8b6fbd-68pzd

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-89b8b6fbd-68pzd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-89b8b6fbd-68pzd

Started

Started container router

openshift-ingress

kubelet

router-default-89b8b6fbd-68pzd

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-64d8557cb6 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-64d8557cb6

SuccessfulCreate

Created pod: kube-auth-proxy-64d8557cb6-c5r7j

openshift-ingress

replicaset-controller

kube-auth-proxy-64d8557cb6

SuccessfulCreate

Created pod: kube-auth-proxy-64d8557cb6-fwh9z
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-64d8557cb6

FailedCreate

Error creating: pods "kube-auth-proxy-64d8557cb6-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-fwh9z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-64d8557cb6-fwh9z

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-c5r7j

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-64d8557cb6-c5r7j

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-r2wv5

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-r2wv5

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-fwh9z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.013s (3.013s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-c5r7j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.876s (2.876s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-fwh9z

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-c5r7j

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-fwh9z

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-64d8557cb6-c5r7j

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.278s (3.278s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.329s (4.329s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tdmbx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-tdmbx

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-cssvh

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-tdmbx

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tdmbx

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tdmbx

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tdmbx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.253s (2.253s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r2wv5

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-r2wv5

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4grfw

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4grfw

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-v8vwn

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v8vwn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-76smh

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-76smh

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-76smh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-v8vwn

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v8vwn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-76smh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.511s (2.511s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-76smh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-76smh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v8vwn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v8vwn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.515s (2.515s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4grfw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4grfw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4grfw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4grfw

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4grfw

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-4ab253-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4ab253-openshift-default-74dbd964db from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-4ab253-openshift-default-74dbd964db

SuccessfulCreate

Created pod: e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4ab253

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4ab253

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-286c27

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-286c27

openshift-ingress

replicaset-controller

e2e-worker-w0-286c27-openshift-default-6c59b96fdd

SuccessfulCreate

Created pod: e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

openshift-ingress

deployment-controller

e2e-inf-a-715253-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-715253-openshift-default-869fbc9f76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-715253-openshift-default-869fbc9f76

SuccessfulCreate

Created pod: e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

openshift-ingress

gateway_labeler_controller

e2e-inf-a-715253

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-715253

openshift-ingress

deployment-controller

e2e-worker-w0-286c27-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-286c27-openshift-default-6c59b96fdd from 0 to 1

openshift-ingress

multus

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.902s (2.902s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-286c27

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-286c27-7b454ddb6c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-286c27

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-286c27: serviceaccount "payload-processing-e2e-worker-w0-286c27" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-286c27-7b454ddb6c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-286c27-7b454ddb6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-286c27: serviceaccount "payload-processing-e2e-worker-w0-286c27" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-286c27-7b454ddb6c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-715253-67b5f999d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-715253-5d66c584cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-715253-5d66c584cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-715253: serviceaccount "payload-processing-e2e-inf-a-715253" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-715253

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-715253-5d66c584cf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-715253-5d66c584cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-715253-67b5f999d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-715253-67b5f999d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-715253: serviceaccount "payload-processing-e2e-inf-a-715253" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-715253

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-715253-67b5f999d6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-37899e-openshift-default-7cf8f5895b

SuccessfulCreate

Created pod: e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

openshift-ingress

deployment-controller

e2e-autores-37899e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-37899e-openshift-default-7cf8f5895b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-37899e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-37899e

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-ait-50ce3a65-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-50ce3a65

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-50ce3a65

openshift-ingress

multus

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd

SuccessfulCreate

Created pod: e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4ab253

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4ab253-7d5776b677

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4ab253-7d5776b677

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4ab253-7d5776b677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4ab253: serviceaccount "payload-processing-e2e-worker-w4-4ab253" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4ab253: serviceaccount "payload-processing-e2e-worker-w4-4ab253" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

openshift-ingress

multus

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4ab253

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4ab253-7d5776b677 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.746s (2.746s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 1.646s (1.646s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.444s (2.444s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Unhealthy

Readiness probe failed: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

ProbeError

Readiness probe error: Get "http://10.134.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-37899e-6c4cd874f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-37899e-6c4cd874f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-37899e: serviceaccount "payload-processing-e2e-autores-37899e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-37899e-6c4cd874f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

openshift-ingress

deployment-controller

payload-processing-e2e-autores-37899e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-37899e-6fb64dc675 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-37899e-6fb64dc675

SuccessfulCreate

Created pod: payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-37899e-6fb64dc675

FailedCreate

Error creating: pods "payload-processing-e2e-autores-37899e-6fb64dc675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-37899e: serviceaccount "payload-processing-e2e-autores-37899e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-37899e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-37899e-6c4cd874f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

openshift-ingress

deployment-controller

payload-processing-e2e-ait-50ce3a65

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-50ce3a65-67477bb875 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-50ce3a65: serviceaccount "payload-processing-e2e-ait-50ce3a65" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-50ce3a65-67477bb875

FailedCreate

Error creating: pods "payload-processing-e2e-ait-50ce3a65-67477bb875-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-50ce3a65: serviceaccount "payload-processing-e2e-ait-50ce3a65" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-50ce3a65-67477bb875

SuccessfulCreate

Created pod: payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

openshift-ingress

kubelet

payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-50ce3a65

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-50ce3a65-77bf66d46 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.768s (1.768s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-9aab53-openshift-default-59d44fc57d

SuccessfulCreate

Created pod: e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9aab53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9aab53

openshift-ingress

deployment-controller

e2e-inf-b-9aab53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9aab53-openshift-default-59d44fc57d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9aab53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9aab53-6df95f7d4f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9aab53: serviceaccount "payload-processing-e2e-inf-b-9aab53" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9aab53-6df95f7d4f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9aab53-6df95f7d4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9aab53: serviceaccount "payload-processing-e2e-inf-b-9aab53" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9aab53-6df95f7d4f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9aab53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9aab53-6dc7975646 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-50ce3a65-77bf66d46-dpbtx

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-50ce3a65-67477bb875-w9hzl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-50ce3a65-openshift-default-5bb9cdbcdd-49f7k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-3f5d8d77-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-3f5d8d77-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3f5d8d77-gw

openshift-ingress

replicaset-controller

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd

SuccessfulCreate

Created pod: e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

openshift-ingress

multus

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3f5d8d77

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3f5d8d77-8c8877b46

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3f5d8d77-8c8877b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3f5d8d77: serviceaccount "payload-processing-e2e-migrate-3f5d8d77" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3f5d8d77: serviceaccount "payload-processing-e2e-migrate-3f5d8d77" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3f5d8d77

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3f5d8d77-8c8877b46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3f5d8d77-8c8877b46

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f5d8d77-5d5bb6478-zrgcc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f5d8d77-8c8877b46-j8rpm

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-feb821e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-feb821e2

openshift-ingress

replicaset-controller

e2e-ait-feb821e2-openshift-default-7d46fd6c8

SuccessfulCreate

Created pod: e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

openshift-ingress

kubelet

e2e-migrate-3f5d8d77-gw-openshift-default-68876b8cdd-27htq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-feb821e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-feb821e2-openshift-default-7d46fd6c8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-feb821e2-77c7fc868f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-feb821e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-feb821e2-77c7fc868f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-feb821e2-77c7fc868f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-feb821e2: serviceaccount "payload-processing-e2e-ait-feb821e2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-feb821e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-feb821e2-77c7fc868f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-feb821e2: serviceaccount "payload-processing-e2e-ait-feb821e2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

openshift-ingress

kubelet

payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-feb821e2-69c9c8b5bb-gqk5w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-feb821e2-77c7fc868f-vkrws

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-derive-5f786284-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-5f786284-openshift-default-7c9858fb96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-5f786284-openshift-default-7c9858fb96

SuccessfulCreate

Created pod: e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

openshift-ingress

GatewayAuthBootstrap

e2e-derive-5f786284

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-derive-5f786284-authn-ssl: envoyfilters.networking.istio.io "e2e-derive-5f786284-authn-ssl" already exists

openshift-ingress

kubelet

e2e-ait-feb821e2-openshift-default-7d46fd6c8-vgjcf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-5f786284

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-5f786284

openshift-ingress

multus

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5f786284-546cb49cc7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5f786284-546cb49cc7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-5f786284-546cb49cc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5f786284: serviceaccount "payload-processing-e2e-derive-5f786284" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5f786284: serviceaccount "payload-processing-e2e-derive-5f786284" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-5f786284

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-5f786284-546cb49cc7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-5f786284

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-37899e-6fb64dc675-dwf5b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5f786284-546cb49cc7-tkr29

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-37899e-6c4cd874f4-jpwwl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f786284-84dbd8cbc4-xtbz8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-5f786284-openshift-default-7c9858fb96-pkpmq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-37899e-openshift-default-7cf8f5895b-gg9wn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-104872-openshift-default-8d7474ddd

SuccessfulCreate

Created pod: e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

openshift-ingress

multus

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-104872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-104872-openshift-default-8d7474ddd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-104872

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-104872

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-104872-8546c44b65

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-104872-8546c44b65-mbr27
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-104872-8546c44b65

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-104872-8546c44b65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-104872: serviceaccount "payload-processing-e2e-explicit-104872" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-104872-56f7db7694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-104872

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-104872-56f7db7694 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-104872

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-104872-8546c44b65 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-104872-56f7db7694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-104872-56f7db7694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-104872: serviceaccount "payload-processing-e2e-explicit-104872" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-104872-8546c44b65-mbr27

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-104872-8546c44b65-mbr27

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-104872-8546c44b65-mbr27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-104872-8546c44b65-mbr27

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-fcdaf27d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fcdaf27d-openshift-default-5746c8b748 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fcdaf27d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fcdaf27d

openshift-ingress

replicaset-controller

e2e-mt-fcdaf27d-openshift-default-5746c8b748

SuccessfulCreate

Created pod: e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

openshift-ingress

multus

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fcdaf27d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fcdaf27d-549c7bfcb5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fcdaf27d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fcdaf27d: serviceaccount "payload-processing-e2e-mt-fcdaf27d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fcdaf27d: serviceaccount "payload-processing-e2e-mt-fcdaf27d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

openshift-ingress

kubelet

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": read tcp 10.134.0.2:50394->10.134.0.59:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": read tcp 10.134.0.2:50394->10.134.0.59:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcdaf27d-fcbc7585d-sbx9n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fcdaf27d-549c7bfcb5-7xx57

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-fcdaf27d-openshift-default-5746c8b748-ndpcf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-104872-8546c44b65-mbr27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-104872-56f7db7694-gvvlg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-104872-openshift-default-8d7474ddd-mdqt6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96

SuccessfulCreate

Created pod: e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

openshift-ingress

kubelet

e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-6baa6b-openshift-default-7758d4b648

SuccessfulCreate

Created pod: e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

openshift-ingress

deployment-controller

e2e-noten-6baa6b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6baa6b-openshift-default-7758d4b648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-6baa6b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6baa6b

openshift-ingress

multus

e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-21e472

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-21e472

openshift-ingress

deployment-controller

e2e-shared-a-w2-21e472-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-21e472-79f78c5467

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-21e472-79f78c5467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-21e472: serviceaccount "payload-processing-e2e-shared-a-w2-21e472" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-21e472

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-21e472: serviceaccount "payload-processing-e2e-shared-a-w2-21e472" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-21e472

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-21e472-79f78c5467 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-21e472-79f78c5467

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-7f85c3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68

SuccessfulCreate

Created pod: e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7f85c3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7f85c3

openshift-ingress

multus

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7f85c3: serviceaccount "payload-processing-e2e-shared-b-w2-7f85c3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7f85c3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7f85c3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7f85c3: serviceaccount "payload-processing-e2e-shared-b-w2-7f85c3" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-715253-67b5f999d6-pqjnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-715253-5d66c584cf-jgbwn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-mt-ed18394d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ed18394d-openshift-default-577dfcb48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-ed18394d-openshift-default-577dfcb48

SuccessfulCreate

Created pod: e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

openshift-ingress

gateway_labeler_controller

e2e-mt-ed18394d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ed18394d

openshift-ingress

multus

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-715253-openshift-default-869fbc9f76-hghvt

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ed18394d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ed18394d-7f986fc7db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ed18394d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ed18394d-689c96cf7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ed18394d-689c96cf7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ed18394d-689c96cf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ed18394d: serviceaccount "payload-processing-e2e-mt-ed18394d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ed18394d-689c96cf7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ed18394d: serviceaccount "payload-processing-e2e-mt-ed18394d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

openshift-ingress

multus

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-noten-6baa6b-openshift-default-7758d4b648-skfnm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9aab53-6df95f7d4f-jmvsr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9aab53-6dc7975646-lbpfg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-a18ac6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-a18ac6

openshift-ingress

replicaset-controller

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb

SuccessfulCreate

Created pod: e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

openshift-ingress

deployment-controller

e2e-shared-a-w3-a18ac6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-9aab53-openshift-default-59d44fc57d-cnf4w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-a18ac6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-a18ac6-87759c959 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a18ac6-87759c959

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-a18ac6-87759c959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a18ac6: serviceaccount "payload-processing-e2e-shared-a-w3-a18ac6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a18ac6: serviceaccount "payload-processing-e2e-shared-a-w3-a18ac6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-a18ac6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a18ac6-87759c959

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Unhealthy

Readiness probe failed: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

ProbeError

Readiness probe error: Get "http://10.132.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4

SuccessfulCreate

Created pod: e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

openshift-ingress

deployment-controller

e2e-shared-b-w3-1bf937-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-1bf937

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-1bf937
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-1bf937

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-1bf937: serviceaccount "payload-processing-e2e-shared-b-w3-1bf937" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-1bf937: serviceaccount "payload-processing-e2e-shared-b-w3-1bf937" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-1bf937

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-ed18394d-689c96cf7-zrljn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ed18394d-7f986fc7db-tgrgw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ed18394d-openshift-default-577dfcb48-52bsg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-95f9c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-95f9c9

openshift-ingress

replicaset-controller

e2e-api-a-95f9c9-openshift-default-857f578d4b

SuccessfulCreate

Created pod: e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

openshift-ingress

deployment-controller

e2e-api-a-95f9c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-95f9c9-openshift-default-857f578d4b from 0 to 1

openshift-ingress

multus

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-95f9c9-58c7db7cc7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-95f9c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-95f9c9-58c7db7cc7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-95f9c9: serviceaccount "payload-processing-e2e-api-a-95f9c9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-95f9c9-58c7db7cc7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-95f9c9-58c7db7cc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-95f9c9: serviceaccount "payload-processing-e2e-api-a-95f9c9" not found

openshift-ingress

multus

payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-95f9c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-95f9c9-5c798dff66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-a93550-openshift-default-784758bccb

SuccessfulCreate

Created pod: e2e-api-b-a93550-openshift-default-784758bccb-5598g

openshift-ingress

deployment-controller

e2e-api-b-a93550-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-a93550-openshift-default-784758bccb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-a93550

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-a93550

openshift-ingress

multus

e2e-api-b-a93550-openshift-default-784758bccb-5598g

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-286c27

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-286c27: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-286c27": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-286c27, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ede4d51e-13d5-4b5c-9c64-bcf650e0db3c, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-286c27-7b454ddb6c-fs5nb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-286c27-bbb5cdbf8-nzqrm

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a93550-87dc4b787

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-a93550-87dc4b787

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-a93550-87dc4b787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a93550: serviceaccount "payload-processing-e2e-api-b-a93550" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-a93550

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-a93550-87dc4b787 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-a93550

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-a93550-5ffddd6d54 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-a93550: serviceaccount "payload-processing-e2e-api-b-a93550" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

openshift-ingress

kubelet

payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-286c27-openshift-default-6c59b96fdd-dkhrh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-a93550-openshift-default-784758bccb-5598g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-a93550-openshift-default-784758bccb-5598g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-a93550-openshift-default-784758bccb-5598g

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-a93550-openshift-default-784758bccb-5598g

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-a93550-openshift-default-784758bccb-5598g

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-95f9c9-5c798dff66-csv5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-95f9c9-58c7db7cc7-9tn9k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-95f9c9-openshift-default-857f578d4b-pvwjl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-a93550-5ffddd6d54-dkcz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-a93550-87dc4b787-qdp6n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-a93550-openshift-default-784758bccb-5598g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4ab253-54b95c96d6-2l98l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4ab253-7d5776b677-f8lpp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-21e472-744f8d5b66-zplv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-21e472-79f78c5467-pgdlz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-4ab253-openshift-default-74dbd964db-pg8r5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-21e472-openshift-default-bfc4cdb96-rr48z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7f85c3-5c48ff96c-2hwxd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7f85c3-7f98f84bc4-t2759

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-7f85c3-openshift-default-58586c7c68-7szdr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-64600a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-64600a

openshift-ingress

replicaset-controller

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96

SuccessfulCreate

Created pod: e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

openshift-ingress

deployment-controller

e2e-ipp-a-64600a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-64600a-openshift-default-5bb9cb9d96 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-64600a-84d7d4868c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-64600a-84d7d4868c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-64600a: serviceaccount "payload-processing-e2e-ipp-a-64600a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-64600a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-64600a: serviceaccount "payload-processing-e2e-ipp-a-64600a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-64600a-84d7d4868c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-64600a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-64600a-84d7d4868c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-f8f6a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f8f6a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f8f6a0

openshift-ingress

replicaset-controller

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6

SuccessfulCreate

Created pod: e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

openshift-ingress

multus

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f8f6a0: serviceaccount "payload-processing-e2e-ipp-b-f8f6a0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f8f6a0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f8f6a0: serviceaccount "payload-processing-e2e-ipp-b-f8f6a0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f8f6a0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2db21a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2db21a

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2db21a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2db21a-664668ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2db21a-664668ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2db21a: serviceaccount "payload-processing-e2e-ipp-cleanup-2db21a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2db21a-664668ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2db21a: serviceaccount "payload-processing-e2e-ipp-cleanup-2db21a" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2db21a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2db21a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2db21a-664668ff from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2db21a-64d6cdb894-dbz72

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2db21a-664668ff-9gs8s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2db21a-openshift-default-5b7fd6547b-psfdz

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-64600a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-64600a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-64600a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-64600a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fcf760dc-eef7-4c78-b759-10027f5b8c15, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-64600a-6b57f45b8b-jbgvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-64600a-84d7d4868c-dl26t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-64600a-openshift-default-5bb9cb9d96-khz74

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-f8f6a0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-f8f6a0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-f8f6a0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-f8f6a0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a864d6fd-4f77-4f9a-ad33-448ddc7320e4, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f8f6a0-6dfd9bc557-m8cf5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f8f6a0-79c8b7c7f4-qrjx2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-f8f6a0-openshift-default-6bdc99cfb6-256sc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a18ac6-87759c959-wt2f4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a18ac6-5888b9c6b6-hb48h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-a18ac6-openshift-default-59576d9ffb-2h7kh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-1bf937-787c9b9c57-wp72v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-1bf937-75cc88878-vnw5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-1bf937-openshift-default-55cb5d6fc4-g7fxb

Killing

Stopping container istio-proxy