Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp to ip-10-0-128-208.ec2.internal

openshift-ingress

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-4ccd57-546878d877-92d5p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-4ccd57-546878d877-92d5p to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6 to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-fgpqt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-fgpqt to ip-10-0-128-208.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8b2xb to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54 to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5 to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6 to ip-10-0-128-208.ec2.internal

openshift-ingress

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f to ip-10-0-128-208.ec2.internal

openshift-ingress

kube-auth-proxy-7f98985fb-kt9sm

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f98985fb-kt9sm to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898 to ip-10-0-128-208.ec2.internal

openshift-ingress

kube-auth-proxy-7f98985fb-xjpv7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f98985fb-xjpv7 to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-x6hfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-x6hfn to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8 to ip-10-0-128-208.ec2.internal

openshift-ingress

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz to ip-10-0-128-247.ec2.internal

openshift-ingress

router-default-6df89d9594-wrhv2

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j to ip-10-0-128-208.ec2.internal

openshift-ingress

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

Scheduled

Successfully assigned openshift-ingress/e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj to ip-10-0-128-247.ec2.internal

openshift-ingress

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9 to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx to ip-10-0-138-116.ec2.internal

openshift-ingress

router-default-6df89d9594-wrhv2

Scheduled

Successfully assigned openshift-ingress/router-default-6df89d9594-wrhv2 to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj to ip-10-0-138-116.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8 to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg to ip-10-0-128-208.ec2.internal

openshift-ingress

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c to ip-10-0-128-247.ec2.internal

openshift-ingress

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-765e6d-openshift-default-874566f4b-699h4 to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

Scheduled

Successfully assigned openshift-ingress/e2e-autores-b08870-openshift-default-5559b9969b-czsd2 to ip-10-0-128-247.ec2.internal

openshift-ingress

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz to ip-10-0-128-208.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-r4zwg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r4zwg to ip-10-0-128-208.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-fflrv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fflrv to ip-10-0-128-247.ec2.internal

openshift-ingress

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65 to ip-10-0-128-247.ec2.internal

openshift-ingress

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5 to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw to ip-10-0-128-247.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh to ip-10-0-128-208.ec2.internal

openshift-ingress

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd to ip-10-0-128-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q to ip-10-0-138-116.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9 to ip-10-0-138-116.ec2.internal

openshift-ingress

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz to ip-10-0-128-247.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6df89d9594 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-6df89d9594

FailedCreate

Error creating: pods "router-default-6df89d9594-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6df89d9594

FailedCreate

Error creating: pods "router-default-6df89d9594-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-6df89d9594

SuccessfulCreate

Created pod: router-default-6df89d9594-wrhv2
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-6df89d9594-wrhv2

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6df89d9594-wrhv2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-6df89d9594-wrhv2

Created

Created container: router

openshift-ingress

kubelet

router-default-6df89d9594-wrhv2

Started

Started container router

openshift-ingress

kubelet

router-default-6df89d9594-wrhv2

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6df89d9594-wrhv2

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-7f98985fb

FailedCreate

Error creating: pods "kube-auth-proxy-7f98985fb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7f98985fb

SuccessfulCreate

Created pod: kube-auth-proxy-7f98985fb-xjpv7

openshift-ingress

replicaset-controller

kube-auth-proxy-7f98985fb

SuccessfulCreate

Created pod: kube-auth-proxy-7f98985fb-kt9sm

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7f98985fb from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-xjpv7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-kt9sm

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-7f98985fb-xjpv7

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-r4zwg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

kube-auth-proxy-7f98985fb-kt9sm

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-kt9sm

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-r4zwg

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-kt9sm

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-kt9sm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.652s (2.652s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-kt9sm

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-xjpv7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.908s (2.908s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-xjpv7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f98985fb-xjpv7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.414s (3.414s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.884s (2.884s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c5kdp8

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-fflrv

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-fflrv

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fflrv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fflrv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fflrv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.245s (4.245s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fflrv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fflrv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fflrv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-r4zwg

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4zwg

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-8b2xb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.498s (2.498s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fgpqt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6hfn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-x6hfn

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-fgpqt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-fgpqt

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-x6hfn

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fgpqt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fgpqt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fgpqt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.743s (1.743s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6hfn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6hfn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.845s (2.845s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-x6hfn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

Unhealthy

Startup probe failed: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-8b2xb

ProbeError

Startup probe error: Get "http://10.132.0.31:15021/healthz/ready": dial tcp 10.132.0.31:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-fffdae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-fffdae

openshift-ingress

deployment-controller

e2e-worker-w4-03f258-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-03f258-openshift-default-6c5c7cdccb from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-fe020d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-fe020d-openshift-default-65cdd9995d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb

SuccessfulCreate

Created pod: e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

openshift-ingress

replicaset-controller

e2e-inf-a-fffdae-openshift-default-6f66bd6b74

SuccessfulCreate

Created pod: e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-fe020d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-fe020d

openshift-ingress

deployment-controller

e2e-inf-a-fffdae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-fffdae-openshift-default-6f66bd6b74 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-fe020d-openshift-default-65cdd9995d

SuccessfulCreate

Created pod: e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-03f258

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-03f258

openshift-ingress

multus

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-fffdae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-fffdae-7f945576fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-fffdae-7f945576fc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-fffdae-7f945576fc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-fffdae-7f945576fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-fffdae: serviceaccount "payload-processing-e2e-inf-a-fffdae" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-fffdae: serviceaccount "payload-processing-e2e-inf-a-fffdae" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-fffdae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-03f258

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-03f258-c9bc9b9f5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-03f258-b6c875758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-03f258

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-03f258-b6c875758 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-03f258: serviceaccount "payload-processing-e2e-worker-w4-03f258" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-03f258-b6c875758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-03f258-b6c875758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-03f258: serviceaccount "payload-processing-e2e-worker-w4-03f258" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-autores-b08870-openshift-default-5559b9969b

SuccessfulCreate

Created pod: e2e-autores-b08870-openshift-default-5559b9969b-czsd2

openshift-ingress

multus

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-b08870

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-b08870

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-fe020d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-b08870-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-b08870-openshift-default-5559b9969b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-fe020d: serviceaccount "payload-processing-e2e-worker-w0-fe020d" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-fe020d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-fe020d: serviceaccount "payload-processing-e2e-worker-w0-fe020d" not found

openshift-ingress

gateway_labeler_controller

e2e-ait-33ff1a95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-33ff1a95

openshift-ingress

deployment-controller

e2e-ait-33ff1a95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-33ff1a95-openshift-default-5c69b8cd5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b

SuccessfulCreate

Created pod: e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

openshift-ingress

multus

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-33ff1a95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-33ff1a95-84dd4788db from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-33ff1a95-cb6d95d4c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-33ff1a95-cb6d95d4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-33ff1a95: serviceaccount "payload-processing-e2e-ait-33ff1a95" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-33ff1a95-cb6d95d4c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-33ff1a95: serviceaccount "payload-processing-e2e-ait-33ff1a95" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-33ff1a95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-33ff1a95-cb6d95d4c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-b08870

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-b08870-659658b6b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b08870-5d4d6ddcf5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-b08870-5d4d6ddcf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b08870: serviceaccount "payload-processing-e2e-autores-b08870" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b08870-659658b6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b08870-659658b6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-b08870-659658b6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b08870: serviceaccount "payload-processing-e2e-autores-b08870" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-b08870

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-b08870-5d4d6ddcf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b08870-5d4d6ddcf5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

ProbeError

Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-765e6d-openshift-default-874566f4b

SuccessfulCreate

Created pod: e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

openshift-ingress

gateway_labeler_controller

e2e-inf-b-765e6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-765e6d

openshift-ingress

deployment-controller

e2e-inf-b-765e6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-765e6d-openshift-default-874566f4b from 0 to 1

openshift-ingress

multus

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

ProbeError

Readiness probe error: Get "http://10.134.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-765e6d-74f87df745

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-765e6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-765e6d-74f87df745 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-765e6d-74f87df745

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-765e6d-74f87df745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-765e6d: serviceaccount "payload-processing-e2e-inf-b-765e6d" not found
(x2)

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-765e6d: serviceaccount "payload-processing-e2e-inf-b-765e6d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-765e6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33ff1a95-84dd4788db-8d6rf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-33ff1a95-cb6d95d4c-d4v2v

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-33ff1a95-openshift-default-5c69b8cd5b-lnncz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-36d266fd-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-36d266fd-gw

openshift-ingress

deployment-controller

e2e-migrate-36d266fd-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-36d266fd-gw-openshift-default-84df997bb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4

SuccessfulCreate

Created pod: e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz
(x6)

openshift-ingress

kubelet

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-36d266fd-85c6b89f98

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-36d266fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-36d266fd-85c6b89f98 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-36d266fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-36d266fd-569bd5574 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-36d266fd-85c6b89f98

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-36d266fd-85c6b89f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-36d266fd: serviceaccount "payload-processing-e2e-migrate-36d266fd" not found

openshift-ingress

multus

payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-36d266fd-569bd5574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-36d266fd-569bd5574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-36d266fd-569bd5574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-36d266fd: serviceaccount "payload-processing-e2e-migrate-36d266fd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-36d266fd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-36d266fd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-36d266fd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-36d266fd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0ad954e9-c464-4de2-ae34-bfd7a963c664, UID in object meta:

openshift-ingress

kubelet

e2e-migrate-36d266fd-gw-openshift-default-84df997bb4-mg8dz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-36d266fd-85c6b89f98-v2h9q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-36d266fd-569bd5574-5vl8j

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-93550aef-openshift-default-7b499975cb

SuccessfulCreate

Created pod: e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

openshift-ingress

deployment-controller

e2e-ait-93550aef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-93550aef-openshift-default-7b499975cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-93550aef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-93550aef

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-93550aef-75d7f86f86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-93550aef-75d7f86f86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-93550aef-75d7f86f86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-93550aef: serviceaccount "payload-processing-e2e-ait-93550aef" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-93550aef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-93550aef-5b49db7f6c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-93550aef-5b49db7f6c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-93550aef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-93550aef-75d7f86f86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-93550aef-5b49db7f6c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-93550aef-5b49db7f6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-93550aef: serviceaccount "payload-processing-e2e-ait-93550aef" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-93550aef-5b49db7f6c-qdlpm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-93550aef-75d7f86f86-jm9zh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-93550aef-openshift-default-7b499975cb-4bbcv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-2d1828d0-openshift-default-79fc9c5f64

SuccessfulCreate

Created pod: e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

openshift-ingress

gateway_labeler_controller

e2e-derive-2d1828d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2d1828d0

openshift-ingress

deployment-controller

e2e-derive-2d1828d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2d1828d0-openshift-default-79fc9c5f64 from 0 to 1

openshift-ingress

multus

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2d1828d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2d1828d0: serviceaccount "payload-processing-e2e-derive-2d1828d0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2d1828d0-7644bcc9df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2d1828d0-7644bcc9df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2d1828d0: serviceaccount "payload-processing-e2e-derive-2d1828d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2d1828d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2d1828d0-7644bcc9df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2d1828d0-7644bcc9df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

openshift-ingress

kubelet

payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-2d1828d0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-2d1828d0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-2d1828d0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-2d1828d0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d84659c-233e-47ae-ac5c-f64a841fd922, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2d1828d0-f9969ddf4-rdltm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-2d1828d0-7644bcc9df-qv7cp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b08870-659658b6b6-hjhhz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b08870-5d4d6ddcf5-4bzzj

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-b08870

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-b08870: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-b08870": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-b08870, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 98555b21-b11e-4f28-bdca-363c8f5eee82, UID in object meta:

openshift-ingress

kubelet

e2e-derive-2d1828d0-openshift-default-79fc9c5f64-7bcbj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-explicit-4ccd57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-4ccd57-openshift-default-7f4985dd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-4ccd57-openshift-default-7f4985dd4

SuccessfulCreate

Created pod: e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

openshift-ingress

kubelet

e2e-autores-b08870-openshift-default-5559b9969b-czsd2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-4ccd57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-4ccd57

openshift-ingress

multus

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4ccd57-546878d877

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-4ccd57-546878d877-92d5p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4ccd57: serviceaccount "payload-processing-e2e-explicit-4ccd57" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-4ccd57-546878d877

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-4ccd57-546878d877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-4ccd57: serviceaccount "payload-processing-e2e-explicit-4ccd57" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-4ccd57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-4ccd57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-4ccd57-546878d877 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-4ccd57-546878d877-92d5p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4ccd57-546878d877-92d5p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-4ccd57-546878d877-92d5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-4ccd57-546878d877-92d5p

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-2bbfe736-openshift-default-76d849cc48

SuccessfulCreate

Created pod: e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

openshift-ingress

gateway_labeler_controller

e2e-mt-2bbfe736

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2bbfe736

openshift-ingress

deployment-controller

e2e-mt-2bbfe736-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2bbfe736-openshift-default-76d849cc48 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2bbfe736-6f4f7779cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2bbfe736-6f4f7779cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2bbfe736: serviceaccount "payload-processing-e2e-mt-2bbfe736" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2bbfe736: serviceaccount "payload-processing-e2e-mt-2bbfe736" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2bbfe736

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2bbfe736-6f4f7779cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2bbfe736

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2bbfe736-6f4f7779cc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-2bbfe736-6f4f7779cc-6rcc9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2bbfe736-657cfb7c54-hdnv8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-2bbfe736-openshift-default-76d849cc48-gxkhn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84

SuccessfulCreate

Created pod: e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

openshift-ingress

deployment-controller

e2e-shared-a-w2-f2241f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-f2241f-openshift-default-6855b78d84 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-f2241f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-f2241f

openshift-ingress

multus

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-f2241f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f2241f: serviceaccount "payload-processing-e2e-shared-a-w2-f2241f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-f2241f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-f2241f: serviceaccount "payload-processing-e2e-shared-a-w2-f2241f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4f70a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4f70a9

openshift-ingress

multus

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4

SuccessfulCreate

Created pod: e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

openshift-ingress

deployment-controller

e2e-shared-b-w2-4f70a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-4ccd57-546878d877-92d5p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-4ccd57-5bd46c7d8b-wh5c6

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4f70a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4f70a9: serviceaccount "payload-processing-e2e-shared-b-w2-4f70a9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4f70a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4f70a9: serviceaccount "payload-processing-e2e-shared-b-w2-4f70a9" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-noten-1cc224

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-1cc224

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-noten-1cc224-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-1cc224-openshift-default-644d7cf99d from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-1cc224-openshift-default-644d7cf99d

SuccessfulCreate

Created pod: e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-4ccd57-openshift-default-7f4985dd4-lzddn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-6cdcda22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6cdcda22-openshift-default-6b75f9444d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6cdcda22-openshift-default-6b75f9444d

SuccessfulCreate

Created pod: e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

openshift-ingress

gateway_labeler_controller

e2e-mt-6cdcda22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6cdcda22

openshift-ingress

multus

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6cdcda22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6cdcda22-5c64d9ff77 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6cdcda22-5c64d9ff77

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6cdcda22-5c64d9ff77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6cdcda22: serviceaccount "payload-processing-e2e-mt-6cdcda22" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6cdcda22-5c64d9ff77

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6cdcda22: serviceaccount "payload-processing-e2e-mt-6cdcda22" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6cdcda22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6cdcda22-586bcff56b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

openshift-ingress

multus

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-1cc224-openshift-default-644d7cf99d-f9trj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-a-fffdae-7f945576fc-z9j7j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-fffdae-846d8cb8b-9bsts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-fffdae-openshift-default-6f66bd6b74-956kw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-765e6d-74f87df745-mxhr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-765e6d-7cc87d5854-kdqmd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-0016d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-0016d4

openshift-ingress

deployment-controller

e2e-shared-a-w3-0016d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4

SuccessfulCreate

Created pod: e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

openshift-ingress

multus

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-765e6d-openshift-default-874566f4b-699h4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-0016d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-0016d4-645c4c996f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0016d4: serviceaccount "payload-processing-e2e-shared-a-w3-0016d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-0016d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0016d4: serviceaccount "payload-processing-e2e-shared-a-w3-0016d4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-w3-92482b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-92482b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-92482b

openshift-ingress

replicaset-controller

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8

SuccessfulCreate

Created pod: e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

openshift-ingress

multus

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-92482b: serviceaccount "payload-processing-e2e-shared-b-w3-92482b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-92482b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-92482b: serviceaccount "payload-processing-e2e-shared-b-w3-92482b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-92482b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6cdcda22-5c64d9ff77-bbssv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6cdcda22-586bcff56b-s6vhq

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-6cdcda22-openshift-default-6b75f9444d-b4z5z

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-54db18

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-54db18

openshift-ingress

deployment-controller

e2e-api-a-54db18-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-54db18-openshift-default-8fbc7c8d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-54db18-openshift-default-8fbc7c8d4

SuccessfulCreate

Created pod: e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

openshift-ingress

multus

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-54db18

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-54db18-7cddcbf978 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-54db18

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-54db18-5b69bfcff5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-54db18-5b69bfcff5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-54db18-5b69bfcff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-54db18: serviceaccount "payload-processing-e2e-api-a-54db18" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-54db18-5b69bfcff5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

openshift-ingress

multus

payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-54db18-7cddcbf978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-54db18-7cddcbf978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-54db18: serviceaccount "payload-processing-e2e-api-a-54db18" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-54db18-7cddcbf978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

openshift-ingress

kubelet

payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-api-b-f667ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f667ee-openshift-default-6977d9548 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-f667ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f667ee

openshift-ingress

replicaset-controller

e2e-api-b-f667ee-openshift-default-6977d9548

SuccessfulCreate

Created pod: e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

openshift-ingress

multus

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f667ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f667ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f667ee-cd6549c99 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f667ee: serviceaccount "payload-processing-e2e-api-b-f667ee" not found
(x6)

openshift-ingress

kubelet

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f667ee-cd6549c99

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f667ee-cd6549c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f667ee: serviceaccount "payload-processing-e2e-api-b-f667ee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f667ee-cd6549c99

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-54db18-7cddcbf978-fkfnm

Killing

Stopping container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-54db18-5b69bfcff5-9qwdq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-54db18-openshift-default-8fbc7c8d4-b95rg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f667ee-76c8c66b4b-gkbjl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f667ee-cd6549c99-wz8mx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-f667ee-openshift-default-6977d9548-tpfl9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-f2241f-586669d47d-lc898

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-f2241f-cff6f9c55-c5h54

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-fe020d-6dfcbdd58f-2vjb6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-fe020d-5897bc68fd-k629j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-f2241f-openshift-default-6855b78d84-gtd4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-fe020d-openshift-default-65cdd9995d-zhb4f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4f70a9-d4d9dcd-nxh4d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4f70a9-ffbd9b96f-87qsw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4f70a9-openshift-default-57fb65bbc4-gkb8c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-03f258-c9bc9b9f5-7qnjd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-03f258-b6c875758-q78xd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-03f258-openshift-default-6c5c7cdccb-8ch65

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-637a6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-637a6f

openshift-ingress

replicaset-controller

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d

SuccessfulCreate

Created pod: e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

openshift-ingress

deployment-controller

e2e-ipp-a-637a6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-637a6f: serviceaccount "payload-processing-e2e-ipp-a-637a6f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-637a6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-637a6f: serviceaccount "payload-processing-e2e-ipp-a-637a6f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-637a6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-637a6f-78755d944b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": read tcp 10.132.0.2:33646->10.132.0.98:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": read tcp 10.132.0.2:33646->10.132.0.98:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-668e8d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-668e8d

openshift-ingress

replicaset-controller

e2e-ipp-b-668e8d-openshift-default-7466677b94

SuccessfulCreate

Created pod: e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

openshift-ingress

deployment-controller

e2e-ipp-b-668e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-668e8d-openshift-default-7466677b94 from 0 to 1

openshift-ingress

multus

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-668e8d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-668e8d-7f86956789 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-668e8d: serviceaccount "payload-processing-e2e-ipp-b-668e8d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-668e8d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-668e8d-7f86956789

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-668e8d-7f86956789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-668e8d: serviceaccount "payload-processing-e2e-ipp-b-668e8d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-668e8d-7f86956789

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

openshift-ingress

multus

payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Unhealthy

Readiness probe failed: Get "http://10.132.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

ProbeError

Readiness probe error: Get "http://10.132.0.101:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-10ec22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-10ec22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-10ec22

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

openshift-ingress

multus

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-10ec22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-10ec22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-10ec22: serviceaccount "payload-processing-e2e-ipp-cleanup-10ec22" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-10ec22: serviceaccount "payload-processing-e2e-ipp-cleanup-10ec22" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-10ec22-5d79dfd9cc-dtl2l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-10ec22-5f88679546-zqf5b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-10ec22-openshift-default-6f946cb55d-m5pjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-637a6f-7bf8b8c98c-qh6jx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-637a6f-78755d944b-wmn4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-637a6f-openshift-default-7d6fbcc68d-xmzx5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-668e8d-5bff4bc59d-67nhg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-668e8d-7f86956789-47rrh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-668e8d-openshift-default-7466677b94-q9qpb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0016d4-645c4c996f-fzcvf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0016d4-7c7b9c49bb-9sfhk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-0016d4-openshift-default-65b5b9c9c4-pd5qz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-92482b-bbfb58bf5-gf25f

Unhealthy

Readiness probe failed: dial tcp 10.133.0.88:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-92482b-774868dc8b-l7lwz

Unhealthy

Readiness probe failed: dial tcp 10.133.0.87:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-w3-92482b-openshift-default-54dd8b75b8-kzbzw

Killing

Stopping container istio-proxy