Time Namespace Component RelatedObject Reason Message

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt to ip-10-0-130-38.ec2.internal

openshift-ingress

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6 to ip-10-0-133-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95 to ip-10-0-133-117.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-s4qms

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-s4qms to ip-10-0-133-92.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-qtc2g

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-qtc2g to ip-10-0-130-38.ec2.internal

openshift-ingress

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-624a770e-openshift-default-6cf65b696-zlghj to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6 to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6 to ip-10-0-130-38.ec2.internal

openshift-ingress

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5 to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77 to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62 to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7 to ip-10-0-133-117.ec2.internal

openshift-ingress

kube-auth-proxy-59c4bbddff-cfr6h

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59c4bbddff-cfr6h to ip-10-0-130-38.ec2.internal

openshift-ingress

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-73521211-openshift-default-549976f7f6-xj8nr to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h to ip-10-0-130-38.ec2.internal

openshift-ingress

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm to ip-10-0-133-92.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-bjkzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-bjkzn to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5 to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-wj2pk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-wj2pk to ip-10-0-130-38.ec2.internal

openshift-ingress

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9 to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl to ip-10-0-133-92.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9sfjv to ip-10-0-130-38.ec2.internal

openshift-ingress

payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc to ip-10-0-133-117.ec2.internal

openshift-ingress

router-default-76489d7779-qr8pc

Scheduled

Successfully assigned openshift-ingress/router-default-76489d7779-qr8pc to ip-10-0-133-92.ec2.internal

openshift-ingress

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7 to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786 to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-ait-73521211-5c774fd84-vj58c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-73521211-5c774fd84-vj58c to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9 to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g to ip-10-0-133-117.ec2.internal

openshift-ingress

kube-auth-proxy-59c4bbddff-cr7cb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59c4bbddff-cr7cb to ip-10-0-133-117.ec2.internal

openshift-ingress

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4 to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls to ip-10-0-133-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr to ip-10-0-133-117.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-76489d7779 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-76489d7779

FailedCreate

Error creating: pods "router-default-76489d7779-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-76489d7779

FailedCreate

Error creating: pods "router-default-76489d7779-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-76489d7779

SuccessfulCreate

Created pod: router-default-76489d7779-qr8pc
(x6)

openshift-ingress

kubelet

router-default-76489d7779-qr8pc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-76489d7779-qr8pc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-76489d7779-qr8pc

Created

Created container: router

openshift-ingress

kubelet

router-default-76489d7779-qr8pc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

kubelet

router-default-76489d7779-qr8pc

Started

Started container router

openshift-ingress

multus

router-default-76489d7779-qr8pc

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

kube-auth-proxy-59c4bbddff

FailedCreate

Error creating: pods "kube-auth-proxy-59c4bbddff-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-59c4bbddff from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cr7cb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-59c4bbddff

SuccessfulCreate

Created pod: kube-auth-proxy-59c4bbddff-cr7cb

openshift-ingress

replicaset-controller

kube-auth-proxy-59c4bbddff

SuccessfulCreate

Created pod: kube-auth-proxy-59c4bbddff-cfr6h

openshift-ingress

multus

kube-auth-proxy-59c4bbddff-cfr6h

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cfr6h

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-59c4bbddff-cr7cb

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-qtc2g

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-qtc2g

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cr7cb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cr7cb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.747s (2.747s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cfr6h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.186s (3.186s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cr7cb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.451s (4.451s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Created

Created container: discovery

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cfr6h

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59c4bbddff-cfr6h

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-s4qms

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-s4qms

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s4qms

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.929s (2.929s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7k8mt

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s4qms

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s4qms

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s4qms

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.343s (2.343s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s4qms

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s4qms

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-qtc2g

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Killing

Stopping container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

ProbeError

Readiness probe error: Get "http://10.132.0.34:8080/ready": dial tcp 10.132.0.34:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-qtc2g

Unhealthy

Readiness probe failed: Get "http://10.132.0.34:8080/ready": dial tcp 10.132.0.34:8080: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9sfjv

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-bjkzn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

multus

payload-processing-5cc6cd444b-bjkzn

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-wj2pk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-bjkzn
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-wj2pk

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wj2pk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wj2pk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wj2pk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wj2pk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.922s (1.922s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-bjkzn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5cc6cd444b-bjkzn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.748s (2.748s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-bjkzn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9sfjv

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-624a770e-openshift-default-6cf65b696

SuccessfulCreate

Created pod: e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

openshift-ingress

gateway_labeler_controller

e2e-ait-624a770e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-624a770e

openshift-ingress

multus

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-ait-624a770e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-624a770e-openshift-default-6cf65b696 from 0 to 1

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.74s (2.74s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-624a770e-8447b8dcb8

FailedCreate

Error creating: pods "payload-processing-e2e-ait-624a770e-8447b8dcb8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-624a770e: serviceaccount "payload-processing-e2e-ait-624a770e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-624a770e-8447b8dcb8

SuccessfulCreate

Created pod: payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

openshift-ingress

deployment-controller

payload-processing-e2e-ait-624a770e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-624a770e-8447b8dcb8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-624a770e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-624a770e-57f7ff69bd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-624a770e: serviceaccount "payload-processing-e2e-ait-624a770e" not found

openshift-ingress

multus

payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-624a770e-8447b8dcb8-m9lhz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-624a770e-57f7ff69bd-z2wt5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-624a770e-openshift-default-6cf65b696-zlghj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d

SuccessfulCreate

Created pod: e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

openshift-ingress

gateway_labeler_controller

e2e-migrate-5d54eb26-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-5d54eb26-gw

openshift-ingress

deployment-controller

e2e-migrate-5d54eb26-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d from 0 to 1

openshift-ingress

multus

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5d54eb26-77479bf77

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

openshift-ingress

multus

payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5d54eb26-77479bf77

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-5d54eb26-77479bf77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5d54eb26: serviceaccount "payload-processing-e2e-migrate-5d54eb26" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-5d54eb26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-5d54eb26-77479bf77 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-5d54eb26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5d54eb26: serviceaccount "payload-processing-e2e-migrate-5d54eb26" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-5d54eb26

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-5d54eb26: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-5d54eb26": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-5d54eb26, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 64121ed4-1e30-4e74-8352-261b1fe8120a, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d54eb26-7d95c4d4fb-s56sc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d54eb26-77479bf77-hnmb4

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-migrate-5d54eb26

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-migrate-5d54eb26: Operation cannot be fulfilled on endpoints "payload-processing-e2e-migrate-5d54eb26": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-migrate-5d54eb26, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4761defb-235a-4baf-9e9b-737cb393c836, UID in object meta:

openshift-ingress

multus

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-73521211-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-73521211-openshift-default-549976f7f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-73521211

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-73521211

openshift-ingress

replicaset-controller

e2e-ait-73521211-openshift-default-549976f7f6

SuccessfulCreate

Created pod: e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

openshift-ingress

multus

payload-processing-e2e-ait-73521211-5c774fd84-vj58c

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-73521211-5c774fd84-vj58c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-73521211-5c774fd84

FailedCreate

Error creating: pods "payload-processing-e2e-ait-73521211-5c774fd84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-73521211: serviceaccount "payload-processing-e2e-ait-73521211" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-73521211-5c774fd84-vj58c

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-73521211-5c774fd84

SuccessfulCreate

Created pod: payload-processing-e2e-ait-73521211-5c774fd84-vj58c

openshift-ingress

multus

payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-73521211

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-73521211-5c774fd84 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-73521211-5c774fd84-vj58c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-73521211-6b8d8f8984

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-73521211-6b8d8f8984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-73521211: serviceaccount "payload-processing-e2e-ait-73521211" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-73521211-6b8d8f8984

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-73521211

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-73521211-6b8d8f8984 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-5d54eb26-gw-openshift-default-7cf944d88d-nvzpv

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-73521211-5c774fd84-vj58c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-73521211-6b8d8f8984-nctk5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-7ba3a489

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-7ba3a489

openshift-ingress

deployment-controller

e2e-derive-7ba3a489-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-7ba3a489-openshift-default-697cbb7784 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-7ba3a489-openshift-default-697cbb7784

SuccessfulCreate

Created pod: e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-73521211-openshift-default-549976f7f6-xj8nr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7ba3a489-8554d5d454

SuccessfulCreate

Created pod: payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-7ba3a489

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-7ba3a489-c66996d9b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-7ba3a489

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-7ba3a489-8554d5d454 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7ba3a489-8554d5d454

FailedCreate

Error creating: pods "payload-processing-e2e-derive-7ba3a489-8554d5d454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7ba3a489: serviceaccount "payload-processing-e2e-derive-7ba3a489" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7ba3a489: serviceaccount "payload-processing-e2e-derive-7ba3a489" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-7ba3a489

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-7ba3a489: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-7ba3a489": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-7ba3a489, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d4be36a7-8471-4612-8fa1-589e060640b2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-7ba3a489-8554d5d454-ljsln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7ba3a489-c66996d9b-54n8g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-7ba3a489-openshift-default-697cbb7784-mwsrx

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-mt-0ea8d0fa

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-0ea8d0fa-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-0ea8d0fa-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-mt-0ea8d0fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0ea8d0fa

openshift-ingress

deployment-controller

e2e-mt-0ea8d0fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0ea8d0fa-openshift-default-5bc4f47988 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988

SuccessfulCreate

Created pod: e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0ea8d0fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0ea8d0fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0ea8d0fa: serviceaccount "payload-processing-e2e-mt-0ea8d0fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0ea8d0fa: serviceaccount "payload-processing-e2e-mt-0ea8d0fa" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-0ea8d0fa-65c79dbd9d-2s786

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0ea8d0fa-6b57d6b488-62v77

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-0ea8d0fa-openshift-default-5bc4f47988-b2v4g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-2fa717fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2fa717fb-openshift-default-548544cf6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-2fa717fb-openshift-default-548544cf6

SuccessfulCreate

Created pod: e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

openshift-ingress

gateway_labeler_controller

e2e-mt-2fa717fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2fa717fb

openshift-ingress

multus

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2fa717fb: serviceaccount "payload-processing-e2e-mt-2fa717fb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2fa717fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2fa717fb-74cddd68f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2fa717fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2fa717fb-74cddd68f8

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2fa717fb-74cddd68f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2fa717fb: serviceaccount "payload-processing-e2e-mt-2fa717fb" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

openshift-ingress

multus

payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2fa717fb-74cddd68f8

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-2fa717fb-74cddd68f8-szfpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fa717fb-5f4cf45f5b-dtk62

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-2fa717fb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-2fa717fb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-2fa717fb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-2fa717fb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c6de032a-b568-463a-98a8-3f4c797def91, UID in object meta:

openshift-ingress

kubelet

e2e-mt-2fa717fb-openshift-default-548544cf6-8xxcn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-a-f03573-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f03573-openshift-default-9966d59f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f03573

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f03573

openshift-ingress

multus

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-f03573-openshift-default-9966d59f4

SuccessfulCreate

Created pod: e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f03573

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f03573-748c77dfd4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f03573

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f03573-c74989d7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f03573: serviceaccount "payload-processing-e2e-inf-a-f03573" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f03573-c74989d7d

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f03573-c74989d7d

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f03573-c74989d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f03573: serviceaccount "payload-processing-e2e-inf-a-f03573" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": read tcp 10.133.0.2:57156->10.133.0.60:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": read tcp 10.133.0.2:57156->10.133.0.60:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a52c4d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a52c4d

openshift-ingress

multus

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86

SuccessfulCreate

Created pod: e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

openshift-ingress

deployment-controller

e2e-inf-b-a52c4d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a52c4d-openshift-default-78dfd7fc86 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a52c4d: serviceaccount "payload-processing-e2e-inf-b-a52c4d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a52c4d-55c8d964c4

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a52c4d-55c8d964c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a52c4d: serviceaccount "payload-processing-e2e-inf-b-a52c4d" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a52c4d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a52c4d-55c8d964c4

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a52c4d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a52c4d-55c8d964c4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f03573-748c77dfd4-crqd6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f03573-c74989d7d-rhzsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-f03573-openshift-default-9966d59f4-49rs9

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-a52c4d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-a52c4d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-a52c4d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-a52c4d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: db4d8407-e540-4dc8-8fde-4ed4d3611d60, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a52c4d-55c8d964c4-wzmrq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a52c4d-5d8d9b8d84-p8dwt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-a1c473-openshift-default-5ff475db94

SuccessfulCreate

Created pod: e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

openshift-ingress

deployment-controller

e2e-api-a-a1c473-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a1c473-openshift-default-5ff475db94 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-a52c4d-openshift-default-78dfd7fc86-8mzhl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-api-a-a1c473

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a1c473

openshift-ingress

multus

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a1c473

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a1c473-7ff64bc75d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a1c473-7ff64bc75d

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a1c473-74659688b8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a1c473-74659688b8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a1c473-74659688b8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a1c473: serviceaccount "payload-processing-e2e-api-a-a1c473" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a1c473-7ff64bc75d

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a1c473-7ff64bc75d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a1c473: serviceaccount "payload-processing-e2e-api-a-a1c473" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a1c473

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a1c473-74659688b8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-e2257c-openshift-default-85ff5cd58

SuccessfulCreate

Created pod: e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

openshift-ingress

multus

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-b-e2257c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e2257c-openshift-default-85ff5cd58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-e2257c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e2257c

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e2257c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e2257c-78bf5bc898 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e2257c: serviceaccount "payload-processing-e2e-api-b-e2257c" not found

openshift-ingress

multus

payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e2257c-78bf5bc898

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e2257c-78bf5bc898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e2257c: serviceaccount "payload-processing-e2e-api-b-e2257c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e2257c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e2257c-78bf5bc898

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

openshift-ingress

kubelet

payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-a1c473-7ff64bc75d-t7sc9

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-a1c473

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-a1c473: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-a1c473": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-a1c473, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 588535c5-9049-49f1-9fd7-ac5df4a1f831, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a1c473-74659688b8-gr8sp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a1c473-openshift-default-5ff475db94-w8cnc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-e2257c-78bf5bc898-57mhn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e2257c-55ffdc98dd-r98c6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-e2257c-openshift-default-85ff5cd58-kf2qz

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-845a26-openshift-default-9678fcb68

SuccessfulCreate

Created pod: e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

openshift-ingress

gateway_labeler_controller

e2e-shared-a-845a26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-845a26

openshift-ingress

deployment-controller

e2e-shared-a-845a26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-845a26-openshift-default-9678fcb68 from 0 to 1

openshift-ingress

multus

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-845a26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-845a26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-845a26-cdf79787d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-845a26-cdf79787d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-845a26-cdf79787d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-845a26-cdf79787d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-845a26: serviceaccount "payload-processing-e2e-shared-a-845a26" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-845a26: serviceaccount "payload-processing-e2e-shared-a-845a26" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

openshift-ingress

kubelet

payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-2b1f1f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-2b1f1f

openshift-ingress

replicaset-controller

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b

SuccessfulCreate

Created pod: e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

openshift-ingress

deployment-controller

e2e-shared-b-2b1f1f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b from 0 to 1

openshift-ingress

multus

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-2b1f1f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-2b1f1f-5c54dc7758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-2b1f1f: serviceaccount "payload-processing-e2e-shared-b-2b1f1f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-2b1f1f: serviceaccount "payload-processing-e2e-shared-b-2b1f1f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-2b1f1f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-10fa8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-10fa8b

openshift-ingress

deployment-controller

e2e-ipp-a-10fa8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-10fa8b-openshift-default-7865b6886b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-10fa8b-openshift-default-7865b6886b

SuccessfulCreate

Created pod: e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

openshift-ingress

multus

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.118s (3.118s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-10fa8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-10fa8b: serviceaccount "payload-processing-e2e-ipp-a-10fa8b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-10fa8b: serviceaccount "payload-processing-e2e-ipp-a-10fa8b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-10fa8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-10fa8b-76d4b9589d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Unhealthy

Readiness probe failed: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

ProbeError

Readiness probe error: Get "http://10.134.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-0d4073

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-0d4073

openshift-ingress

deployment-controller

e2e-ipp-b-0d4073-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-0d4073-openshift-default-65bd7fc488 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-0d4073-openshift-default-65bd7fc488

SuccessfulCreate

Created pod: e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

openshift-ingress

multus

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0d4073: serviceaccount "payload-processing-e2e-ipp-b-0d4073" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-0d4073

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-0d4073-5f86d56468 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0d4073-5f86d56468

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-0d4073-5f86d56468

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-0d4073-5f86d56468-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-0d4073: serviceaccount "payload-processing-e2e-ipp-b-0d4073" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-0d4073

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2d48ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2d48ec

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2d48ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2d48ec

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2d48ec: serviceaccount "payload-processing-e2e-ipp-cleanup-2d48ec" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2d48ec: serviceaccount "payload-processing-e2e-ipp-cleanup-2d48ec" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2d48ec

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2d48ec-58df6cff6d-slf95

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2d48ec-69c575c68d-hhpls

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2d48ec-openshift-default-6c4b6fb56-6sncl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-10fa8b-76d4b9589d-4vzdh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-10fa8b-5b95fd84d4-nd8st

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-10fa8b-openshift-default-7865b6886b-p9xgm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-0d4073-7468ccbd48-wmkl7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-0d4073-5f86d56468-h49zr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-0d4073-openshift-default-65bd7fc488-hmzx6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-845a26-74cffd7c8d-gcnzh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-845a26-cdf79787d-k4thx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-845a26-openshift-default-9678fcb68-hzmsl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-2b1f1f-7d988665bd-4649h

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-2b1f1f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-2b1f1f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-2b1f1f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-2b1f1f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7915d13e-f8e4-4233-8b5f-d24d6ea62d16, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-2b1f1f-5c54dc7758-wfdx7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-2b1f1f-openshift-default-64ff5b5f5b-f4r2s

Killing

Stopping container istio-proxy