Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Scheduled

Successfully assigned openshift-ingress/e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx to ip-10-0-143-142.ec2.internal

openshift-ingress

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4 to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7 to ip-10-0-143-142.ec2.internal

openshift-ingress

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm to ip-10-0-143-142.ec2.internal

openshift-ingress

kube-auth-proxy-58b8d644dc-tc66s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-58b8d644dc-tc66s to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

Scheduled

Successfully assigned openshift-ingress/e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5 to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn to ip-10-0-136-145.ec2.internal

openshift-ingress

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l to ip-10-0-136-145.ec2.internal

openshift-ingress

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp to ip-10-0-136-145.ec2.internal

openshift-ingress

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66 to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8 to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4 to ip-10-0-143-142.ec2.internal

openshift-ingress

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h to ip-10-0-136-145.ec2.internal

openshift-ingress

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-4cf126-openshift-default-78bc667884-grpnh to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2 to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8f54f1-647457757-dnz2r to ip-10-0-143-142.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-f8cm7 to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9 to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz to ip-10-0-128-28.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-gfkr2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-gfkr2 to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-gvzs6

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-gvzs6 to ip-10-0-136-145.ec2.internal

openshift-ingress

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2 to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x to ip-10-0-136-145.ec2.internal

openshift-ingress

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf to ip-10-0-136-145.ec2.internal

openshift-ingress

kube-auth-proxy-58b8d644dc-6cm72

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-58b8d644dc-6cm72 to ip-10-0-143-142.ec2.internal

openshift-ingress

router-default-6545c9995b-hxggn

Scheduled

Successfully assigned openshift-ingress/router-default-6545c9995b-hxggn to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6 to ip-10-0-143-142.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-gpwnm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-gpwnm to ip-10-0-143-142.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl to ip-10-0-143-142.ec2.internal

openshift-ingress

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2 to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5 to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n to ip-10-0-136-145.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-98j97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-98j97 to ip-10-0-143-142.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml to ip-10-0-128-28.ec2.internal

openshift-ingress

payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg to ip-10-0-128-28.ec2.internal

openshift-ingress

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-38b04325-openshift-default-58856786bd-r7qr5 to ip-10-0-143-142.ec2.internal

openshift-ingress

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97 to ip-10-0-128-28.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6545c9995b from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-6545c9995b

FailedCreate

Error creating: pods "router-default-6545c9995b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6545c9995b

FailedCreate

Error creating: pods "router-default-6545c9995b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6545c9995b

SuccessfulCreate

Created pod: router-default-6545c9995b-hxggn
(x5)

openshift-ingress

kubelet

router-default-6545c9995b-hxggn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-6545c9995b-hxggn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6545c9995b-hxggn

Started

Started container router

openshift-ingress

multus

router-default-6545c9995b-hxggn

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6545c9995b-hxggn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-6545c9995b-hxggn

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-58b8d644dc from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-58b8d644dc

SuccessfulCreate

Created pod: kube-auth-proxy-58b8d644dc-6cm72

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-6cm72

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-58b8d644dc

SuccessfulCreate

Created pod: kube-auth-proxy-58b8d644dc-tc66s
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-58b8d644dc

FailedCreate

Error creating: pods "kube-auth-proxy-58b8d644dc-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-gfkr2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-tc66s

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-6cm72

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-58b8d644dc-6cm72

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-58b8d644dc-tc66s

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-gfkr2

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-tc66s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-6cm72

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-6cm72

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-tc66s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-6cm72

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.815s (2.815s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-tc66s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.842s (2.842s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-58b8d644dc-tc66s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.172s (4.172s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.954s (2.954s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ggt5b

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-gpwnm

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-gpwnm

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gpwnm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gpwnm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.384s (2.384s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gpwnm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gpwnm

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-gfkr2

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-gfkr2

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-f8cm7

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-gvzs6

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-98j97

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-gvzs6

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-98j97

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-98j97

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gvzs6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-98j97

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-98j97

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gvzs6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.708s (1.708s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-98j97

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.125s (2.125s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gvzs6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-gvzs6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-f8cm7

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-06f0f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-06f0f6

openshift-ingress

deployment-controller

e2e-inf-a-06f0f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-06f0f6-openshift-default-789fc96d5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-06f0f6-openshift-default-789fc96d5d

SuccessfulCreate

Created pod: e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-06f0f6: serviceaccount "payload-processing-e2e-inf-a-06f0f6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-06f0f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-06f0f6-5c864564fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-06f0f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-06f0f6-5c864564fc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-06f0f6-5c864564fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-06f0f6: serviceaccount "payload-processing-e2e-inf-a-06f0f6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-06f0f6-5c864564fc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

openshift-ingress

multus

payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-28fa6ddd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-28fa6ddd

openshift-ingress

multus

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-28fa6ddd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-28fa6ddd-openshift-default-8748f47f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-28fa6ddd-openshift-default-8748f47f8

SuccessfulCreate

Created pod: e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

openshift-ingress

replicaset-controller

e2e-autores-9e1e8d-openshift-default-858f58f5f8

SuccessfulCreate

Created pod: e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

openshift-ingress

gateway_labeler_controller

e2e-autores-9e1e8d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-9e1e8d

openshift-ingress

deployment-controller

e2e-autores-9e1e8d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-9e1e8d-openshift-default-858f58f5f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69

SuccessfulCreate

Created pod: payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-28fa6ddd: serviceaccount "payload-processing-e2e-ait-28fa6ddd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-28fa6ddd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-28fa6ddd-5c77c9cd69 from 0 to 1

openshift-ingress

multus

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-28fa6ddd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69

FailedCreate

Error creating: pods "payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-28fa6ddd: serviceaccount "payload-processing-e2e-ait-28fa6ddd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

openshift-ingress

multus

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.848s (2.848s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9e1e8d-7954c5bfd9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-9e1e8d-7954c5bfd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9e1e8d: serviceaccount "payload-processing-e2e-autores-9e1e8d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-9e1e8d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-9e1e8d-754564d7b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-9e1e8d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-9e1e8d-7954c5bfd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-9e1e8d-7954c5bfd9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-9e1e8d: serviceaccount "payload-processing-e2e-autores-9e1e8d" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-3102b2-openshift-default-9db689dd

SuccessfulCreate

Created pod: e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

openshift-ingress

deployment-controller

e2e-inf-b-3102b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3102b2-openshift-default-9db689dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3102b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3102b2

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x6)

openshift-ingress

kubelet

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.269s (2.269s including waiting). Image size: 181318953 bytes.
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3102b2: serviceaccount "payload-processing-e2e-inf-b-3102b2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3102b2-784cf48687

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3102b2-784cf48687-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3102b2: serviceaccount "payload-processing-e2e-inf-b-3102b2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3102b2-784cf48687

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3102b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3102b2-784cf48687 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3102b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-28fa6ddd-5c77c9cd69-lw7nl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-28fa6ddd-55b5d77b74-hhjm8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-28fa6ddd-openshift-default-8748f47f8-xqt6s

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-28fa6ddd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-28fa6ddd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-28fa6ddd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 53ae38d5-3a7f-4930-adde-91730407bb82, UID in object meta:

openshift-ingress

replicaset-controller

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656

SuccessfulCreate

Created pod: e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

openshift-ingress

deployment-controller

e2e-migrate-f86b6ac3-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-f86b6ac3-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f86b6ac3-gw

openshift-ingress

multus

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f86b6ac3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f86b6ac3: serviceaccount "payload-processing-e2e-migrate-f86b6ac3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f86b6ac3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f86b6ac3: serviceaccount "payload-processing-e2e-migrate-f86b6ac3" not found
(x5)

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.334s (2.334s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.35s (2.35s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

ProbeError

Readiness probe error: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:38742->10.134.0.37:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Unhealthy

Readiness probe failed: Get "http://10.134.0.37:15021/healthz/ready": read tcp 10.134.0.2:38742->10.134.0.37:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ait-b910426f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b910426f

openshift-ingress

replicaset-controller

e2e-ait-b910426f-openshift-default-5cc74cf55b

SuccessfulCreate

Created pod: e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

openshift-ingress

deployment-controller

e2e-ait-b910426f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b910426f-openshift-default-5cc74cf55b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-f86b6ac3-8dbb8cb46-q5hcf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f86b6ac3-778b98777d-vzrxt

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b910426f-7765f84cff

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b910426f-7765f84cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b910426f: serviceaccount "payload-processing-e2e-ait-b910426f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b910426f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b910426f-7765f84cff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b910426f-7765f84cff

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

openshift-ingress

kubelet

e2e-migrate-f86b6ac3-gw-openshift-default-548d6cc656-zlh97

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b910426f-857457c986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b910426f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b910426f-857457c986 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b910426f-857457c986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b910426f-857457c986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b910426f: serviceaccount "payload-processing-e2e-ait-b910426f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b910426f-857457c986-pfh7r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b910426f-7765f84cff-mpgwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b910426f-openshift-default-5cc74cf55b-4rpjf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-38b04325

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-38b04325

openshift-ingress

deployment-controller

e2e-derive-38b04325-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-38b04325-openshift-default-58856786bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-38b04325-openshift-default-58856786bd

SuccessfulCreate

Created pod: e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

openshift-ingress

multus

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-9e1e8d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-9e1e8d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-9e1e8d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7b4fec10-1e1c-47b1-b9f4-2bb9d5b53657, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-9e1e8d-7954c5bfd9-5vz9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-9e1e8d-754564d7b6-j4k5l

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-38b04325-5fc79677c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-38b04325-5fc79677c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-38b04325-5fc79677c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-38b04325: serviceaccount "payload-processing-e2e-derive-38b04325" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-38b04325

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-38b04325-5fc79677c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-38b04325

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-38b04325-dbdf5b4df from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-38b04325-dbdf5b4df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-38b04325-dbdf5b4df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-38b04325-dbdf5b4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-38b04325: serviceaccount "payload-processing-e2e-derive-38b04325" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-f447ae-openshift-default-6b79fb8c88

SuccessfulCreate

Created pod: e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

openshift-ingress

deployment-controller

e2e-explicit-f447ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f447ae-openshift-default-6b79fb8c88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-f447ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f447ae

openshift-ingress

kubelet

e2e-autores-9e1e8d-openshift-default-858f58f5f8-b5kdp

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f447ae-64bbc4b86f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

openshift-ingress

kubelet

payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f447ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f447ae: serviceaccount "payload-processing-e2e-explicit-f447ae" not found

openshift-ingress

multus

payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f447ae-64bbc4b86f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f447ae-64bbc4b86f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f447ae: serviceaccount "payload-processing-e2e-explicit-f447ae" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f447ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f447ae-64bbc4b86f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-38b04325-openshift-default-58856786bd-r7qr5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-38b04325-dbdf5b4df-h2nl6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-38b04325-5fc79677c4-qmbh5

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f447ae-7c765d6cf4-pg2dm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-f447ae

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-f447ae: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-f447ae": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-f447ae, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d71fc96-f8b3-40b8-be8d-6072c1c18281, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-f447ae-64bbc4b86f-rcs8h

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-noten-6223ec-openshift-default-57d4cb5b98

SuccessfulCreate

Created pod: e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-6223ec

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6223ec

openshift-ingress

deployment-controller

e2e-noten-6223ec-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6223ec-openshift-default-57d4cb5b98 from 0 to 1

openshift-ingress

multus

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-f447ae-openshift-default-6b79fb8c88-47wz2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-mt-f838f49c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f838f49c

openshift-ingress

deployment-controller

e2e-mt-f838f49c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f838f49c-openshift-default-666dbdbc5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-f838f49c-openshift-default-666dbdbc5b

SuccessfulCreate

Created pod: e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

openshift-ingress

multus

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f838f49c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f838f49c-85f7497965 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f838f49c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f838f49c-865696f77d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f838f49c-865696f77d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f838f49c-865696f77d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f838f49c-865696f77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f838f49c: serviceaccount "payload-processing-e2e-mt-f838f49c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f838f49c-85f7497965

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f838f49c-85f7497965

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f838f49c-85f7497965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f838f49c: serviceaccount "payload-processing-e2e-mt-f838f49c" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-6223ec-openshift-default-57d4cb5b98-wrdqx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-06f0f6-5c864564fc-bv5qd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-06f0f6-76d84cc48b-fz84l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-06f0f6-openshift-default-789fc96d5d-cfwrp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f838f49c-865696f77d-hf4vm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-f838f49c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-f838f49c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-f838f49c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-f838f49c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 31382580-f255-4b6b-9552-dec7412ddf36, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-f838f49c-85f7497965-9s5ml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3102b2-79d5dcd758-srgnp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3102b2-784cf48687-ml6vr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-f838f49c-openshift-default-666dbdbc5b-dvdbd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88

SuccessfulCreate

Created pod: e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

openshift-ingress

deployment-controller

e2e-shared-a-w3-15d5e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-15d5e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-15d5e2

openshift-ingress

multus

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-3102b2-openshift-default-9db689dd-c95p4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-15d5e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-15d5e2: serviceaccount "payload-processing-e2e-shared-a-w3-15d5e2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-15d5e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-15d5e2: serviceaccount "payload-processing-e2e-shared-a-w3-15d5e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-d03ead

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-d03ead

openshift-ingress

deployment-controller

e2e-shared-a-w2-d03ead-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-d03ead-openshift-default-b8567694d from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-d03ead-openshift-default-b8567694d

SuccessfulCreate

Created pod: e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d03ead: serviceaccount "payload-processing-e2e-shared-a-w2-d03ead" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d03ead: serviceaccount "payload-processing-e2e-shared-a-w2-d03ead" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-d03ead

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-d03ead

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": read tcp 10.132.0.2:38110->10.132.0.58:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": read tcp 10.132.0.2:38110->10.132.0.58:15021: read: connection reset by peer

openshift-ingress

deployment-controller

e2e-shared-b-w3-7fa21f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b

SuccessfulCreate

Created pod: e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7fa21f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7fa21f
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Started

Started container istio-proxy

openshift-ingress

multus

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7fa21f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f: serviceaccount "payload-processing-e2e-shared-b-w3-7fa21f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7fa21f: serviceaccount "payload-processing-e2e-shared-b-w3-7fa21f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7fa21f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7fa21f-687c545dff from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b

SuccessfulCreate

Created pod: e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

openshift-ingress

deployment-controller

e2e-shared-b-w2-b9edc3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b9edc3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b9edc3

openshift-ingress

multus

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b9edc3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b9edc3: serviceaccount "payload-processing-e2e-shared-b-w2-b9edc3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b9edc3: serviceaccount "payload-processing-e2e-shared-b-w2-b9edc3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b9edc3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-424fbbc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-424fbbc4-openshift-default-58cdd9dd44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-424fbbc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-424fbbc4

openshift-ingress

replicaset-controller

e2e-mt-424fbbc4-openshift-default-58cdd9dd44

SuccessfulCreate

Created pod: e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

openshift-ingress

multus

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-424fbbc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-424fbbc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-424fbbc4-7c9774b889 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-424fbbc4-7c9774b889

SuccessfulCreate

Created pod: payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-424fbbc4: serviceaccount "payload-processing-e2e-mt-424fbbc4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-424fbbc4-7c9774b889

FailedCreate

Error creating: pods "payload-processing-e2e-mt-424fbbc4-7c9774b889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-424fbbc4: serviceaccount "payload-processing-e2e-mt-424fbbc4" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-424fbbc4-7c9774b889-wffjg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-424fbbc4-85cb4c8dc8-fg94x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-424fbbc4-openshift-default-58cdd9dd44-jdqnk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-4cf126

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-4cf126

openshift-ingress

deployment-controller

e2e-api-a-4cf126-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-4cf126-openshift-default-78bc667884 from 0 to 1

openshift-ingress

multus

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-4cf126-openshift-default-78bc667884

SuccessfulCreate

Created pod: e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-4cf126

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-4cf126-54bd9f7795 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

openshift-ingress

multus

payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4cf126: serviceaccount "payload-processing-e2e-api-a-4cf126" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4cf126-54bd9f7795

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

openshift-ingress

multus

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-4cf126-54bd9f7795

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-4cf126-54bd9f7795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-4cf126: serviceaccount "payload-processing-e2e-api-a-4cf126" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-4cf126

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-8f54f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8f54f1-openshift-default-6b5679bf94 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-8f54f1-openshift-default-6b5679bf94

SuccessfulCreate

Created pod: e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

openshift-ingress

gateway_labeler_controller

e2e-api-b-8f54f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8f54f1

openshift-ingress

multus

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8f54f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8f54f1-647457757 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8f54f1-647457757

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8f54f1-647457757-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8f54f1: serviceaccount "payload-processing-e2e-api-b-8f54f1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8f54f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8f54f1-8b57985fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8f54f1: serviceaccount "payload-processing-e2e-api-b-8f54f1" not found

openshift-ingress

multus

payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8f54f1-647457757

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-4cf126-664b7cfcb6-6qgsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-4cf126-54bd9f7795-qqq8k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-4cf126-openshift-default-78bc667884-grpnh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f54f1-647457757-dnz2r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f54f1-8b57985fd-76wn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-8f54f1-openshift-default-6b5679bf94-2dk7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d03ead-59ff9b79c5-qpdkb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d03ead-7fdbd6f56b-b5sz7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-d03ead-openshift-default-b8567694d-6w57s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

Unhealthy

Readiness probe failed: dial tcp 10.134.0.61:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

Unhealthy

Readiness probe failed: dial tcp 10.134.0.60:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b9edc3-d8dc7474b-zglw9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b9edc3-654fcbd755-4nwv2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-b9edc3-openshift-default-5dc767749b-m6wpn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-52269e-openshift-default-784c5dfb8

SuccessfulCreate

Created pod: e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-52269e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-52269e

openshift-ingress

deployment-controller

e2e-ipp-a-52269e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-52269e-openshift-default-784c5dfb8 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-52269e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-52269e-55c54c446b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-52269e: serviceaccount "payload-processing-e2e-ipp-a-52269e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-52269e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-52269e-59c47cc88c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-52269e-59c47cc88c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-52269e-59c47cc88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-52269e: serviceaccount "payload-processing-e2e-ipp-a-52269e" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-52269e-59c47cc88c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-629e95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-629e95

openshift-ingress

deployment-controller

e2e-ipp-b-629e95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-629e95-openshift-default-84cb9fcfb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8

SuccessfulCreate

Created pod: e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

openshift-ingress

multus

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-629e95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-629e95-b4f9676cf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-629e95-878687946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-629e95-878687946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-629e95: serviceaccount "payload-processing-e2e-ipp-b-629e95" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-629e95-b4f9676cf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-629e95-b4f9676cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-629e95: serviceaccount "payload-processing-e2e-ipp-b-629e95" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-629e95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-629e95-878687946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-629e95-878687946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-629e95-b4f9676cf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-f420a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-f420a1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

openshift-ingress

deployment-controller

e2e-ipp-cleanup-f420a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1: serviceaccount "payload-processing-e2e-ipp-cleanup-f420a1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-f420a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f420a1: serviceaccount "payload-processing-e2e-ipp-cleanup-f420a1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-f420a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f420a1-c7f7b4bf8-x6t4t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f420a1-58fb5cd9d7-dcrsn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-f420a1-openshift-default-6d6fb47db4-xgq5n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-52269e-55c54c446b-tqhws

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-52269e-59c47cc88c-lr24f

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-52269e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-52269e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-52269e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: acfcd272-47fe-4cd3-8554-b4cd79d75084, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-52269e-openshift-default-784c5dfb8-gcwmw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-629e95-b4f9676cf-rqp66

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-629e95-878687946-knwsq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-629e95-openshift-default-84cb9fcfb8-j6hrf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-15d5e2-6b6855546c-zn4t5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-15d5e2-5dd8bb68fd-95xgx

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-15d5e2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-15d5e2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-15d5e2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aa912d76-fe50-441a-aede-d601eeaf765b, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-15d5e2-openshift-default-55c6dd5b88-mrb8d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7fa21f-687c545dff-7cqd2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7fa21f-5c8cb6579d-z927p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-7fa21f-openshift-default-57876d6c5b-8r25h

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503