Time Namespace Component RelatedObject Reason Message

openshift-ingress

kube-auth-proxy-5f57c6d865-s8j24

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9 to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz to ip-10-0-138-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-wgc58

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58 to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6 to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4 to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt to ip-10-0-138-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-lqnps

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lqnps to ip-10-0-139-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52 to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8 to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5 to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf to ip-10-0-138-211.ec2.internal

openshift-ingress

router-default-7c7d59dc6d-jbgwm

Scheduled

Successfully assigned openshift-ingress/router-default-7c7d59dc6d-jbgwm to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42 to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-noten-090464-openshift-default-6769ffc478-dv4m6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6 to ip-10-0-138-211.ec2.internal

openshift-ingress

kube-auth-proxy-5f57c6d865-67rlh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5f57c6d865-67rlh to ip-10-0-139-27.ec2.internal

openshift-ingress

payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-xg9bn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

Scheduled

Successfully assigned openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2 to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 to ip-10-0-138-211.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-4wlhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4wlhv to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs to ip-10-0-135-192.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Scheduled

Successfully assigned openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb to ip-10-0-135-192.ec2.internal

openshift-ingress

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx to ip-10-0-138-211.ec2.internal

openshift-ingress

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Scheduled

Successfully assigned openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg to ip-10-0-135-192.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78 to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf to ip-10-0-138-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg to ip-10-0-138-211.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7c7d59dc6d from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-7c7d59dc6d

FailedCreate

Error creating: pods "router-default-7c7d59dc6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-7c7d59dc6d

FailedCreate

Error creating: pods "router-default-7c7d59dc6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-7c7d59dc6d

SuccessfulCreate

Created pod: router-default-7c7d59dc6d-jbgwm
(x5)

openshift-ingress

kubelet

router-default-7c7d59dc6d-jbgwm

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-7c7d59dc6d-jbgwm

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-7c7d59dc6d-jbgwm

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7c7d59dc6d-jbgwm

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-7c7d59dc6d-jbgwm

Started

Started container router

openshift-ingress

kubelet

router-default-7c7d59dc6d-jbgwm

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-5f57c6d865

SuccessfulCreate

Created pod: kube-auth-proxy-5f57c6d865-s8j24

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-s8j24

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-67rlh

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5f57c6d865

SuccessfulCreate

Created pod: kube-auth-proxy-5f57c6d865-67rlh

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5f57c6d865 from 0 to 2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-5f57c6d865-s8j24

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-s8j24

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-lqnps

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-lqnps

openshift-ingress

multus

kube-auth-proxy-5f57c6d865-67rlh

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-67rlh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-67rlh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-s8j24

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-s8j24

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-67rlh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-s8j24

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.163s (3.163s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5f57c6d865-67rlh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.154s (3.154s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.585s (4.585s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.223s (4.223s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-wgc58

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-wgc58

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wgc58

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wgc58

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.725s (2.725s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wgc58

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wgc58

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-lqnps

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-lqnps

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-pr7x5

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.507s (4.507s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4wlhv

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-xg9bn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xg9bn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-xg9bn

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wlhv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-4wlhv

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xg9bn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xg9bn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-xg9bn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.372s (1.372s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wlhv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wlhv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4wlhv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.503s (2.503s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Unhealthy

Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

ProbeError

Readiness probe error: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-pr7x5

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-cfe049

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-cfe049

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-2faea3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-2faea3

openshift-ingress

gateway_labeler_controller

e2e-inf-a-76944c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-76944c

openshift-ingress

multus

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-2faea3-openshift-default-684fcb68f6

SuccessfulCreate

Created pod: e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

openshift-ingress

replicaset-controller

e2e-inf-a-76944c-openshift-default-74b57f9cb8

SuccessfulCreate

Created pod: e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

openshift-ingress

deployment-controller

e2e-worker-w4-2faea3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-2faea3-openshift-default-684fcb68f6 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd

SuccessfulCreate

Created pod: e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

openshift-ingress

deployment-controller

e2e-worker-w0-cfe049-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-cfe049-openshift-default-789ff4c9cd from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-76944c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-76944c-openshift-default-74b57f9cb8 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-76944c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-76944c-9547b46bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-76944c-9547b46bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-76944c-9547b46bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-76944c: serviceaccount "payload-processing-e2e-inf-a-76944c" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-76944c-b98cdb4bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-76944c-b98cdb4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-76944c: serviceaccount "payload-processing-e2e-inf-a-76944c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-76944c-9547b46bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-76944c-b98cdb4bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-76944c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-76944c-b98cdb4bc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-2faea3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2faea3: serviceaccount "payload-processing-e2e-worker-w4-2faea3" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-2faea3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-2faea3-8967d5cc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2faea3-8967d5cc5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-2faea3-8967d5cc5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-2faea3-8967d5cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-2faea3: serviceaccount "payload-processing-e2e-worker-w4-2faea3" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cfe049: serviceaccount "payload-processing-e2e-worker-w0-cfe049" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-cfe049

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-cfe049-d899c755c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cfe049-d899c755c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-cfe049-d899c755c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-cfe049: serviceaccount "payload-processing-e2e-worker-w0-cfe049" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-cfe049-d899c755c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-cfe049

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-cfe049-5987b94558 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-4df62ae2-openshift-default-fc695d94d

SuccessfulCreate

Created pod: e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

openshift-ingress

deployment-controller

e2e-ait-4df62ae2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4df62ae2-openshift-default-fc695d94d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-4df62ae2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4df62ae2

openshift-ingress

deployment-controller

e2e-autores-f492a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-f492a5-openshift-default-c55496f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-f492a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-f492a5

openshift-ingress

replicaset-controller

e2e-autores-f492a5-openshift-default-c55496f6

SuccessfulCreate

Created pod: e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

openshift-ingress

multus

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4df62ae2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4df62ae2-777f584bc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4df62ae2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4df62ae2-777f584bc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4df62ae2-777f584bc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4df62ae2: serviceaccount "payload-processing-e2e-ait-4df62ae2" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4df62ae2: serviceaccount "payload-processing-e2e-ait-4df62ae2" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4df62ae2-777f584bc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a146d6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a146d6

openshift-ingress

deployment-controller

e2e-inf-b-a146d6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a146d6-openshift-default-5c4cd669dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-a146d6-openshift-default-5c4cd669dd

SuccessfulCreate

Created pod: e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

openshift-ingress

multus

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-f492a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-f492a5-f6c4bd958 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f492a5-f6c4bd958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-f492a5-f6c4bd958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f492a5: serviceaccount "payload-processing-e2e-autores-f492a5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f492a5-65d86f588c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-f492a5-65d86f588c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-f492a5: serviceaccount "payload-processing-e2e-autores-f492a5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-f492a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-f492a5-65d86f588c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-f492a5-65d86f588c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

openshift-ingress

kubelet

payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-f492a5-f6c4bd958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

openshift-ingress

multus

payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a146d6-67856d6767

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a146d6-67856d6767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a146d6: serviceaccount "payload-processing-e2e-inf-b-a146d6" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a146d6: serviceaccount "payload-processing-e2e-inf-b-a146d6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a146d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a146d6-866c948b6b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a146d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a146d6-67856d6767 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a146d6-67856d6767

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-3932eef5-gw-openshift-default-84fb977968

SuccessfulCreate

Created pod: e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

openshift-ingress

deployment-controller

e2e-migrate-3932eef5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3932eef5-gw-openshift-default-84fb977968 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-3932eef5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3932eef5-gw

openshift-ingress

multus

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3932eef5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3932eef5-79bd899bcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3932eef5-79bd899bcd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3932eef5-79bd899bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3932eef5: serviceaccount "payload-processing-e2e-migrate-3932eef5" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3932eef5: serviceaccount "payload-processing-e2e-migrate-3932eef5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3932eef5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3932eef5-79bd899bcd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

openshift-ingress

kubelet

payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-3932eef5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-3932eef5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 60d84240-5a3b-408d-8a08-2047c1b091ee, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-56ff2313

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-56ff2313

openshift-ingress

replicaset-controller

e2e-ait-56ff2313-openshift-default-74774c6b44

SuccessfulCreate

Created pod: e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

openshift-ingress

deployment-controller

e2e-ait-56ff2313-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-56ff2313-openshift-default-74774c6b44 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-56ff2313

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-56ff2313-64999c5d8c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-56ff2313: serviceaccount "payload-processing-e2e-ait-56ff2313" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-56ff2313-64999c5d8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-56ff2313

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-56ff2313-558dfd74c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-56ff2313-64999c5d8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-56ff2313-64999c5d8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-56ff2313: serviceaccount "payload-processing-e2e-ait-56ff2313" not found
(x2)

openshift-ingress

kubelet

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-56ff2313

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-56ff2313: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-56ff2313": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-56ff2313, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 22c62d28-9f83-4b0b-b314-5edd26ef1347, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-derive-8e10e0b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-8e10e0b5-openshift-default-8bc4554cb from 0 to 1

openshift-ingress

kubelet

e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-8e10e0b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-8e10e0b5

openshift-ingress

replicaset-controller

e2e-derive-8e10e0b5-openshift-default-8bc4554cb

SuccessfulCreate

Created pod: e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

openshift-ingress

multus

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8e10e0b5: serviceaccount "payload-processing-e2e-derive-8e10e0b5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-8e10e0b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-8e10e0b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-8e10e0b5-7bf6544d4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-8e10e0b5: serviceaccount "payload-processing-e2e-derive-8e10e0b5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-autores-f492a5-65d86f588c-g44lf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-f492a5-openshift-default-c55496f6-h9dc2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-abe86c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-abe86c-openshift-default-89dd5b576 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-abe86c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-abe86c

openshift-ingress

replicaset-controller

e2e-explicit-abe86c-openshift-default-89dd5b576

SuccessfulCreate

Created pod: e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

openshift-ingress

multus

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-abe86c-64c65b57c7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-abe86c-64c65b57c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-abe86c: serviceaccount "payload-processing-e2e-explicit-abe86c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-abe86c-64c65b57c7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-abe86c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-abe86c-64c65b57c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-abe86c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-abe86c: serviceaccount "payload-processing-e2e-explicit-abe86c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-44007f60-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-44007f60-openshift-default-d97d4d88d from 0 to 1

openshift-ingress

multus

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-44007f60

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-44007f60

openshift-ingress

replicaset-controller

e2e-mt-44007f60-openshift-default-d97d4d88d

SuccessfulCreate

Created pod: e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-44007f60-7b4d7f7b97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-44007f60-6497d5d494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

openshift-ingress

deployment-controller

payload-processing-e2e-mt-44007f60

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-44007f60-7b4d7f7b97 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-44007f60-6497d5d494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-44007f60-6497d5d494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-44007f60: serviceaccount "payload-processing-e2e-mt-44007f60" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-44007f60-7b4d7f7b97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-44007f60-7b4d7f7b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-44007f60: serviceaccount "payload-processing-e2e-mt-44007f60" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-44007f60

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-44007f60-6497d5d494 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-44007f60

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-44007f60: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-44007f60": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-44007f60, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f4ea8197-f018-4afd-a1cb-07306e46bd73, UID in object meta:

openshift-ingress

kubelet

e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-48e479

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-48e479

openshift-ingress

replicaset-controller

e2e-shared-a-w2-48e479-openshift-default-67cf754568

SuccessfulCreate

Created pod: e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

openshift-ingress

deployment-controller

e2e-shared-a-w2-48e479-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-48e479-openshift-default-67cf754568 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x

Killing

Stopping container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-48e479: serviceaccount "payload-processing-e2e-shared-a-w2-48e479" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-48e479

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-48e479-6b95f76bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-48e479

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-48e479: serviceaccount "payload-processing-e2e-shared-a-w2-48e479" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-edbd82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-edbd82

openshift-ingress

multus

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d

SuccessfulCreate

Created pod: e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

openshift-ingress

deployment-controller

e2e-shared-b-w2-edbd82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82: serviceaccount "payload-processing-e2e-shared-b-w2-edbd82" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-edbd82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-edbd82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82: serviceaccount "payload-processing-e2e-shared-b-w2-edbd82" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-090464-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-090464-openshift-default-6769ffc478 from 0 to 1

openshift-ingress

kubelet

e2e-noten-090464-openshift-default-6769ffc478-dv4m6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-090464-openshift-default-6769ffc478-dv4m6

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-090464-openshift-default-6769ffc478-dv4m6

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-090464-openshift-default-6769ffc478-dv4m6

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-090464

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-090464

openshift-ingress

replicaset-controller

e2e-noten-090464-openshift-default-6769ffc478

SuccessfulCreate

Created pod: e2e-noten-090464-openshift-default-6769ffc478-dv4m6

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-c5ae0fdd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-c5ae0fdd

openshift-ingress

deployment-controller

e2e-mt-c5ae0fdd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-c5ae0fdd-openshift-default-67545b9b56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-c5ae0fdd-openshift-default-67545b9b56

SuccessfulCreate

Created pod: e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

openshift-ingress

multus

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

openshift-ingress

deployment-controller

payload-processing-e2e-mt-c5ae0fdd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c5ae0fdd: serviceaccount "payload-processing-e2e-mt-c5ae0fdd" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-c5ae0fdd: serviceaccount "payload-processing-e2e-mt-c5ae0fdd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-c5ae0fdd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-090464-openshift-default-6769ffc478-dv4m6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a146d6-67856d6767-29js9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-47a2db-openshift-default-855b787b8

SuccessfulCreate

Created pod: e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

openshift-ingress

deployment-controller

e2e-shared-a-w3-47a2db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-47a2db-openshift-default-855b787b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-47a2db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-47a2db
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db: serviceaccount "payload-processing-e2e-shared-a-w3-47a2db" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db: serviceaccount "payload-processing-e2e-shared-a-w3-47a2db" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-47a2db

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-47a2db

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646

SuccessfulCreate

Created pod: e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

openshift-ingress

deployment-controller

e2e-shared-b-w3-07f9f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-07f9f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-07f9f2

openshift-ingress

multus

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-07f9f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2: serviceaccount "payload-processing-e2e-shared-b-w3-07f9f2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2: serviceaccount "payload-processing-e2e-shared-b-w3-07f9f2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-07f9f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": read tcp 10.133.0.2:46554->10.133.0.76:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": read tcp 10.133.0.2:46554->10.133.0.76:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-0f806c-openshift-default-ffc79cf58

SuccessfulCreate

Created pod: e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

openshift-ingress

deployment-controller

e2e-api-a-0f806c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-0f806c-openshift-default-ffc79cf58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-0f806c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-0f806c

openshift-ingress

multus

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0f806c-699d98ccc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-0f806c-699d98ccc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-0f806c-699d98ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0f806c: serviceaccount "payload-processing-e2e-api-a-0f806c" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-0f806c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-0f806c-fc78c48cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-0f806c: serviceaccount "payload-processing-e2e-api-a-0f806c" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-0f806c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-0f806c-699d98ccc from 0 to 1

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-1b3aae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-1b3aae

openshift-ingress

deployment-controller

e2e-api-b-1b3aae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-1b3aae-openshift-default-6c87ff896 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-1b3aae-openshift-default-6c87ff896

SuccessfulCreate

Created pod: e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

openshift-ingress

multus

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1b3aae-759899696c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-1b3aae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-1b3aae-759899696c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-1b3aae-759899696c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-1b3aae-759899696c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1b3aae: serviceaccount "payload-processing-e2e-api-b-1b3aae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-1b3aae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-1b3aae: serviceaccount "payload-processing-e2e-api-b-1b3aae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-cfe049

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-cfe049": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 32e90f38-42b8-41ed-8fdc-c5aac6a6b53d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-b-1b3aae-759899696c-kphpv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-eaba37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4

SuccessfulCreate

Created pod: e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-eaba37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-eaba37

openshift-ingress

multus

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eaba37: serviceaccount "payload-processing-e2e-ipp-a-eaba37" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

openshift-ingress

multus

payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-eaba37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-eaba37-9594bdff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-eaba37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eaba37-9594bdff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-eaba37-9594bdff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-eaba37-9594bdff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-eaba37: serviceaccount "payload-processing-e2e-ipp-a-eaba37" not found

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Unhealthy

Readiness probe failed: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

ProbeError

Readiness probe error: Get "http://10.134.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a8402d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a8402d

openshift-ingress

deployment-controller

e2e-ipp-b-a8402d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a8402d-openshift-default-dddb88d66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a8402d-openshift-default-dddb88d66

SuccessfulCreate

Created pod: e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

openshift-ingress

multus

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a8402d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a8402d: serviceaccount "payload-processing-e2e-ipp-b-a8402d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a8402d: serviceaccount "payload-processing-e2e-ipp-b-a8402d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a8402d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446

SuccessfulCreate

Created pod: e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-cfebd7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-cfebd7

openshift-ingress

deployment-controller

e2e-ipp-cleanup-cfebd7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-cfebd7-openshift-default-769d576446 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-cfebd7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7: serviceaccount "payload-processing-e2e-ipp-cleanup-cfebd7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7: serviceaccount "payload-processing-e2e-ipp-cleanup-cfebd7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-cfebd7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Unhealthy

Readiness probe failed: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

ProbeError

Readiness probe error: Get "http://10.134.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: