Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d5891124-6bbf985965-z2lht

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d5891124-6bbf985965-z2lht to ip-10-0-136-98.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

Scheduled

Successfully assigned openshift-ingress/e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt to ip-10-0-135-242.ec2.internal

openshift-ingress

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p to ip-10-0-137-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7 to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2 to ip-10-0-136-98.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-h6qjt to ip-10-0-137-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8 to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-8hfz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-8hfz8 to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2 to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw to ip-10-0-135-242.ec2.internal

openshift-ingress

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7 to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn to ip-10-0-137-30.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7 to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4 to ip-10-0-135-242.ec2.internal

openshift-ingress

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5 to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7 to ip-10-0-137-30.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4 to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6 to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9 to ip-10-0-137-30.ec2.internal

openshift-ingress

kube-auth-proxy-6f67fb6dbc-hrwds

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f67fb6dbc-hrwds to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-6lkxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-6lkxj to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj to ip-10-0-136-98.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-wtg7l

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-wtg7l to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79 to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg to ip-10-0-135-242.ec2.internal

openshift-ingress

router-default-5bb97b79b-6jf4w

Scheduled

Successfully assigned openshift-ingress/router-default-5bb97b79b-6jf4w to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88 to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j to ip-10-0-135-242.ec2.internal

openshift-ingress

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Scheduled

Successfully assigned openshift-ingress/e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw to ip-10-0-137-30.ec2.internal

openshift-ingress

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg to ip-10-0-137-30.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m to ip-10-0-135-242.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854 to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v to ip-10-0-136-98.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6dkqn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6dkqn to ip-10-0-136-98.ec2.internal

openshift-ingress

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7 to ip-10-0-136-98.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248 to ip-10-0-135-242.ec2.internal

openshift-ingress

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw to ip-10-0-137-30.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q to ip-10-0-135-242.ec2.internal

openshift-ingress

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq to ip-10-0-136-98.ec2.internal

openshift-ingress

kube-auth-proxy-6f67fb6dbc-96rxq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f67fb6dbc-96rxq to ip-10-0-135-242.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5bb97b79b from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

openshift-ingress

replicaset-controller

router-default-5bb97b79b

FailedCreate

Error creating: pods "router-default-5bb97b79b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x17)

openshift-ingress

replicaset-controller

router-default-5bb97b79b

FailedCreate

Error creating: pods "router-default-5bb97b79b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5bb97b79b

SuccessfulCreate

Created pod: router-default-5bb97b79b-6jf4w
(x6)

openshift-ingress

kubelet

router-default-5bb97b79b-6jf4w

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5bb97b79b-6jf4w

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-5bb97b79b-6jf4w

Created

Created container: router

openshift-ingress

multus

router-default-5bb97b79b-6jf4w

AddedInterface

Add eth0 [10.133.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5bb97b79b-6jf4w

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-5bb97b79b-6jf4w

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-6f67fb6dbc

SuccessfulCreate

Created pod: kube-auth-proxy-6f67fb6dbc-96rxq
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6f67fb6dbc

FailedCreate

Error creating: pods "kube-auth-proxy-6f67fb6dbc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6f67fb6dbc from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-96rxq

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-hrwds

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6f67fb6dbc

SuccessfulCreate

Created pod: kube-auth-proxy-6f67fb6dbc-hrwds

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6dkqn

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6dkqn

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-hrwds

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6f67fb6dbc-hrwds

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6f67fb6dbc-96rxq

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-96rxq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-96rxq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-96rxq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-96rxq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.72s (2.72s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-hrwds

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.728s (4.728s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-hrwds

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 5.313s (5.313s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f67fb6dbc-hrwds

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wtg7l

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-wtg7l

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-wtg7l

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wtg7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wtg7l

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6dkqn

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6dkqn

Killing

Stopping container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-wrsnp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.622s (2.622s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-h6qjt

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkxj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-6lkxj

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-6lkxj

openshift-ingress

multus

payload-processing-5b54b7fbb7-8hfz8

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8hfz8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-8hfz8

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkxj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.454s (1.454s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkxj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6lkxj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8hfz8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.162s (2.162s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8hfz8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8hfz8

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h6qjt

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-68f7cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-68f7cd

openshift-ingress

replicaset-controller

e2e-worker-w0-739ee7-openshift-default-6b558b95b8

SuccessfulCreate

Created pod: e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

openshift-ingress

replicaset-controller

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb

SuccessfulCreate

Created pod: e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

openshift-ingress

deployment-controller

e2e-inf-a-f79e22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f79e22-openshift-default-6b95ddbbfb from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w4-68f7cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f79e22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f79e22

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-f79e22

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-f79e22-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-f79e22-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8

SuccessfulCreate

Created pod: e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-739ee7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-739ee7

openshift-ingress

deployment-controller

e2e-worker-w0-739ee7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-739ee7-openshift-default-6b558b95b8 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.611s (2.611s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f79e22-d7bb99c67

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f79e22-d7bb99c67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f79e22: serviceaccount "payload-processing-e2e-inf-a-f79e22" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f79e22-d7bb99c67

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f79e22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f79e22-65c94f966 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f79e22-65c94f966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f79e22-65c94f966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f79e22-65c94f966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f79e22: serviceaccount "payload-processing-e2e-inf-a-f79e22" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f79e22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f79e22-d7bb99c67 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-739ee7: serviceaccount "payload-processing-e2e-worker-w0-739ee7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-739ee7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-739ee7: serviceaccount "payload-processing-e2e-worker-w0-739ee7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-739ee7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-739ee7-567bbbbfbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-00a141-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-00a141-openshift-default-5fbf7f84cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-00a141

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-00a141

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-autores-00a141-openshift-default-5fbf7f84cb

SuccessfulCreate

Created pod: e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-5fb73413

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5fb73413

openshift-ingress

multus

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-5fb73413-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5fb73413-openshift-default-5f6c6f8bfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd

SuccessfulCreate

Created pod: e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

openshift-ingress

multus

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-68f7cd: serviceaccount "payload-processing-e2e-worker-w4-68f7cd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-68f7cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-68f7cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-68f7cd-b87c4cd47 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-68f7cd: serviceaccount "payload-processing-e2e-worker-w4-68f7cd" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-00a141-57f8c95cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-00a141-57f8c95cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-00a141: serviceaccount "payload-processing-e2e-autores-00a141" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-00a141

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-00a141-566ccbb6c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-00a141-566ccbb6c5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-00a141-566ccbb6c5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-00a141-566ccbb6c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-00a141: serviceaccount "payload-processing-e2e-autores-00a141" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-00a141-57f8c95cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-00a141

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-00a141-57f8c95cfd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5fb73413-7d6dcc8549

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

openshift-ingress

multus

payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5fb73413

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5fb73413-7d6dcc8549 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5fb73413

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5fb73413-67fcc64454 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5fb73413-7d6dcc8549

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5fb73413-7d6dcc8549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5fb73413: serviceaccount "payload-processing-e2e-ait-5fb73413" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5fb73413-67fcc64454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

openshift-ingress

kubelet

payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5fb73413-67fcc64454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5fb73413-67fcc64454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5fb73413: serviceaccount "payload-processing-e2e-ait-5fb73413" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-ef3317-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ef3317-openshift-default-5fc7758954 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ef3317

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ef3317

openshift-ingress

replicaset-controller

e2e-inf-b-ef3317-openshift-default-5fc7758954

SuccessfulCreate

Created pod: e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ef3317: serviceaccount "payload-processing-e2e-inf-b-ef3317" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ef3317

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ef3317-6c548d6886 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ef3317-d77796fb5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ef3317-d77796fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ef3317: serviceaccount "payload-processing-e2e-inf-b-ef3317" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ef3317

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ef3317-d77796fb5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ef3317-d77796fb5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-5fb73413-7d6dcc8549-7gb6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-5fb73413-openshift-default-5f6c6f8bfd-q449s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5fb73413-67fcc64454-vb854

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-4c69c87e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4c69c87e-gw

openshift-ingress

multus

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b

SuccessfulCreate

Created pod: e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

openshift-ingress

deployment-controller

e2e-migrate-4c69c87e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4c69c87e-7fbfc76566

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4c69c87e-7fbfc76566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4c69c87e: serviceaccount "payload-processing-e2e-migrate-4c69c87e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4c69c87e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4c69c87e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4c69c87e-7fbfc76566 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4c69c87e: serviceaccount "payload-processing-e2e-migrate-4c69c87e" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4c69c87e-7fbfc76566

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

openshift-ingress

kubelet

payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4c69c87e-b747d5d66-ghrtp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4c69c87e-7fbfc76566-jskc6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-4c69c87e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-4c69c87e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-4c69c87e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-4c69c87e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 12c3e284-5806-4f15-bd68-fa29c0a57681, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ait-1f9d3de8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1f9d3de8

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

e2e-ait-1f9d3de8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1f9d3de8-openshift-default-558d9746fb from 0 to 1

openshift-ingress

kubelet

e2e-migrate-4c69c87e-gw-openshift-default-58fdd84f9b-bm59k

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-1f9d3de8-openshift-default-558d9746fb

SuccessfulCreate

Created pod: e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

openshift-ingress

multus

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1f9d3de8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1f9d3de8-c676b46c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1f9d3de8-c676b46c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1f9d3de8-c676b46c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1f9d3de8-c676b46c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1f9d3de8: serviceaccount "payload-processing-e2e-ait-1f9d3de8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1f9d3de8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1f9d3de8: serviceaccount "payload-processing-e2e-ait-1f9d3de8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1f9d3de8-6689dc949d-dbh9v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1f9d3de8-c676b46c-ct4br

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-c2aae110-openshift-default-68489dd8c6

SuccessfulCreate

Created pod: e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

openshift-ingress

deployment-controller

e2e-derive-c2aae110-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c2aae110-openshift-default-68489dd8c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-c2aae110

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c2aae110

openshift-ingress

multus

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

Unhealthy

Readiness probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-1f9d3de8-openshift-default-558d9746fb-g427p

ProbeError

Readiness probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c2aae110

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c2aae110-67d84bcf9c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c2aae110

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c2aae110-9d5d48658 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c2aae110-9d5d48658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c2aae110-9d5d48658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c2aae110-9d5d48658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c2aae110: serviceaccount "payload-processing-e2e-derive-c2aae110" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c2aae110-67d84bcf9c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

openshift-ingress

multus

payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c2aae110-67d84bcf9c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c2aae110-67d84bcf9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c2aae110: serviceaccount "payload-processing-e2e-derive-c2aae110" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-00a141-57f8c95cfd-7dz9j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-00a141-566ccbb6c5-q8zfr

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c2aae110-9d5d48658-c2s88

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-c2aae110-openshift-default-68489dd8c6-ptxhw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-c2aae110-67d84bcf9c-f7cjw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-f1730c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f1730c

openshift-ingress

replicaset-controller

e2e-explicit-f1730c-openshift-default-8465fb68f6

SuccessfulCreate

Created pod: e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

openshift-ingress

deployment-controller

e2e-explicit-f1730c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f1730c-openshift-default-8465fb68f6 from 0 to 1

openshift-ingress

multus

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-00a141-openshift-default-5fbf7f84cb-cqvsw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f1730c-64d6f885f7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f1730c-64d6f885f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f1730c: serviceaccount "payload-processing-e2e-explicit-f1730c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f1730c-64d6f885f7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f1730c-849989c546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f1730c-849989c546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f1730c: serviceaccount "payload-processing-e2e-explicit-f1730c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f1730c-849989c546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f1730c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f1730c-849989c546 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f1730c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f1730c-64d6f885f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-cadab1d8-openshift-default-6dbc8f7584

SuccessfulCreate

Created pod: e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

openshift-ingress

deployment-controller

e2e-mt-cadab1d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cadab1d8-openshift-default-6dbc8f7584 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-cadab1d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cadab1d8

openshift-ingress

multus

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cadab1d8: serviceaccount "payload-processing-e2e-mt-cadab1d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cadab1d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cadab1d8-77459fd95c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cadab1d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cadab1d8-77459fd95c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cadab1d8-77459fd95c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cadab1d8: serviceaccount "payload-processing-e2e-mt-cadab1d8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cadab1d8-77459fd95c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

openshift-ingress

kubelet

payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-cadab1d8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-cadab1d8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-cadab1d8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-cadab1d8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0fe03d3c-4962-4324-be71-8bd746f1a5ce, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cadab1d8-7865d97d4b-5s6l8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cadab1d8-77459fd95c-rx7g4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-cadab1d8-openshift-default-6dbc8f7584-bx6vm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f1730c-849989c546-mdq9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f1730c-64d6f885f7-4zm6p

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-noten-52c0e5-openshift-default-7fcfc54f84

SuccessfulCreate

Created pod: e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

openshift-ingress

deployment-controller

e2e-noten-52c0e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-52c0e5-openshift-default-7fcfc54f84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-52c0e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-52c0e5

openshift-ingress

kubelet

e2e-explicit-f1730c-openshift-default-8465fb68f6-452zg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-cadd00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-cadd00

openshift-ingress

deployment-controller

e2e-shared-a-w2-cadd00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4

SuccessfulCreate

Created pod: e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

openshift-ingress

multus

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cadd00: serviceaccount "payload-processing-e2e-shared-a-w2-cadd00" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-cadd00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-cadd00-777886d4c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cadd00: serviceaccount "payload-processing-e2e-shared-a-w2-cadd00" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-cadd00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-noten-52c0e5-openshift-default-7fcfc54f84-ml82p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-51ae50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-51ae50-openshift-default-6f99749974 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-51ae50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-51ae50

openshift-ingress

replicaset-controller

e2e-shared-b-w2-51ae50-openshift-default-6f99749974

SuccessfulCreate

Created pod: e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-51ae50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-51ae50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-51ae50: serviceaccount "payload-processing-e2e-shared-b-w2-51ae50" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-51ae50: serviceaccount "payload-processing-e2e-shared-b-w2-51ae50" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-d5891124-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d5891124-openshift-default-7bb7875776 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-d5891124

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d5891124

openshift-ingress

replicaset-controller

e2e-mt-d5891124-openshift-default-7bb7875776

SuccessfulCreate

Created pod: e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

openshift-ingress

multus

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d5891124

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d5891124-6bbf985965 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d5891124-6bbf985965

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d5891124-6bbf985965-z2lht
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d5891124-6bbf985965

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d5891124-6bbf985965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d5891124: serviceaccount "payload-processing-e2e-mt-d5891124" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d5891124-64d987f7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d5891124-64d987f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d5891124: serviceaccount "payload-processing-e2e-mt-d5891124" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d5891124-64d987f7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d5891124

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d5891124-64d987f7d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d5891124-6bbf985965-z2lht

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-d5891124-6bbf985965-z2lht

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d5891124-6bbf985965-z2lht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-d5891124-6bbf985965-z2lht

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f79e22-d7bb99c67-jdhwk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f79e22-65c94f966-k9trf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-f79e22-openshift-default-6b95ddbbfb-6xxlx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef3317-d77796fb5-lbxvw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef3317-6c548d6886-c42m4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-ef3317-openshift-default-5fc7758954-c5gn7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-0a9008-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-0a9008

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-0a9008

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb

SuccessfulCreate

Created pod: e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0a9008: serviceaccount "payload-processing-e2e-shared-a-w3-0a9008" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-0a9008

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-0a9008

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0a9008: serviceaccount "payload-processing-e2e-shared-a-w3-0a9008" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-shared-b-w3-0e94e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-0e94e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-0e94e5

openshift-ingress

replicaset-controller

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646

SuccessfulCreate

Created pod: e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

openshift-ingress

multus

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0e94e5: serviceaccount "payload-processing-e2e-shared-b-w3-0e94e5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-0e94e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-0e94e5-7785856677 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0e94e5-7785856677

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-0e94e5-7785856677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0e94e5: serviceaccount "payload-processing-e2e-shared-b-w3-0e94e5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-0e94e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0e94e5-7785856677

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d5891124-6bbf985965-z2lht

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d5891124-64d987f7d-zgzhp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-d5891124-openshift-default-7bb7875776-mxjt9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-8641cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8641cd-openshift-default-59659946bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-8641cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8641cd

openshift-ingress

replicaset-controller

e2e-api-a-8641cd-openshift-default-59659946bd

SuccessfulCreate

Created pod: e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

openshift-ingress

multus

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8641cd: serviceaccount "payload-processing-e2e-api-a-8641cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8641cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8641cd-55dcf449fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8641cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8641cd-5cc7c446c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8641cd-5cc7c446c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8641cd-5cc7c446c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8641cd-5cc7c446c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8641cd: serviceaccount "payload-processing-e2e-api-a-8641cd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-api-b-352217-openshift-default-bd49f79fd

SuccessfulCreate

Created pod: e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

openshift-ingress

deployment-controller

e2e-api-b-352217-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-352217-openshift-default-bd49f79fd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-352217

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-352217

openshift-ingress

multus

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-352217

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-352217-576fdfb6fc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-352217-74cf89c58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-352217-74cf89c58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-352217: serviceaccount "payload-processing-e2e-api-b-352217" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-352217

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-352217-74cf89c58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-352217-74cf89c58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-352217-576fdfb6fc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-352217-576fdfb6fc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-352217-576fdfb6fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-352217: serviceaccount "payload-processing-e2e-api-b-352217" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-739ee7-bfb8dbf4b-77h7v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-739ee7-567bbbbfbc-bv248

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-739ee7-openshift-default-6b558b95b8-tnstg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-8641cd-5cc7c446c-b9cxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8641cd-55dcf449fd-ggv9m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-8641cd-openshift-default-59659946bd-8bkc5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-352217-74cf89c58-qz9cq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-352217-576fdfb6fc-mf84z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-352217-openshift-default-bd49f79fd-rc5dz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cadd00-777886d4c7-m2qqj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cadd00-7cd6d785f8-x8cw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-68f7cd-b87c4cd47-hkq6q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-68f7cd-6cbd566bc4-5vpfj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-cadd00-openshift-default-5d66d6d7f4-kggsw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-68f7cd-openshift-default-7f8fd578d8-dbt7c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-51ae50-69cc5d5dfc-dqwvr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-51ae50-56c4644758-jhzjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-51ae50-openshift-default-6f99749974-ghkd7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-869204

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-869204

openshift-ingress

deployment-controller

e2e-ipp-a-869204-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-869204-openshift-default-d75468dc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-869204-openshift-default-d75468dc6

SuccessfulCreate

Created pod: e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

openshift-ingress

multus

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-869204

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-869204-78d8fbbc55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-869204-78d8fbbc55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-869204-78d8fbbc55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-869204-78d8fbbc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-869204: serviceaccount "payload-processing-e2e-ipp-a-869204" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-869204

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-869204-74b9b4669d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-869204: serviceaccount "payload-processing-e2e-ipp-a-869204" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-89b7ca-openshift-default-795b96b54d

SuccessfulCreate

Created pod: e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-89b7ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-89b7ca

openshift-ingress

deployment-controller

e2e-ipp-b-89b7ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-89b7ca-openshift-default-795b96b54d from 0 to 1

openshift-ingress

multus

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-89b7ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-89b7ca: serviceaccount "payload-processing-e2e-ipp-b-89b7ca" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-89b7ca: serviceaccount "payload-processing-e2e-ipp-b-89b7ca" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-89b7ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b03a3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b03a3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b03a3f

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

openshift-ingress

multus

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b03a3f: serviceaccount "payload-processing-e2e-ipp-cleanup-b03a3f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b03a3f: serviceaccount "payload-processing-e2e-ipp-cleanup-b03a3f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b03a3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b03a3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b03a3f-5dd7ddd4bf-42tgt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b03a3f-5694f9cfcd-h29zh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b03a3f-openshift-default-5ff98cd574-7sb79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-869204-74b9b4669d-lqjf7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-869204

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-869204: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-869204": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-869204, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a79d1c74-de5d-4cf6-9f63-05c513187cc6, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-869204-78d8fbbc55-4c9zz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-869204-openshift-default-d75468dc6-bqkrq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-89b7ca-6fcdcdbd55-jqxw2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-89b7ca-bb46c547d-pn2df

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-89b7ca-openshift-default-795b96b54d-pz22t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0a9008-54dfc4d547-v2wfg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0a9008-6d8479cf8-6zkz7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-0a9008-openshift-default-55bf7997cb-7g7km

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0e94e5-7785856677-fdzh7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0e94e5-7dd675bd54-bbkhk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-0e94e5-openshift-default-5c6d64c646-fx6hn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503