Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg to ip-10-0-128-105.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-j97pv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-j97pv to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-ait-383709f1-58d76669d5-mxtff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-383709f1-58d76669d5-mxtff to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9 to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6 to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-qds2c

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-qds2c to ip-10-0-128-124.ec2.internal

openshift-ingress

e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586 to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w to ip-10-0-128-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq to ip-10-0-128-105.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5 to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8 to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv to ip-10-0-128-124.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6 to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8 to ip-10-0-136-162.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-27gxt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-27gxt to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-17d457-openshift-default-f97bdc56-h7f88 to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9 to ip-10-0-136-162.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vlz4j to ip-10-0-136-162.ec2.internal

openshift-ingress

kube-auth-proxy-746c8b5fff-js2tp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-746c8b5fff-js2tp to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-42670434-856bd87574-pdzds

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-42670434-856bd87574-pdzds to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-fzzg5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-fzzg5 to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9 to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4 to ip-10-0-136-162.ec2.internal

openshift-ingress

kube-auth-proxy-746c8b5fff-jpqm6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-746c8b5fff-jpqm6 to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw to ip-10-0-136-162.ec2.internal

openshift-ingress

router-default-54bc6fdd74-dstmh

Scheduled

Successfully assigned openshift-ingress/router-default-54bc6fdd74-dstmh to ip-10-0-128-124.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4 to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Scheduled

Successfully assigned openshift-ingress/e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q to ip-10-0-128-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2 to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl to ip-10-0-136-162.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8 to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt to ip-10-0-128-105.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6 to ip-10-0-128-105.ec2.internal

openshift-ingress

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl to ip-10-0-136-162.ec2.internal

openshift-ingress

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn to ip-10-0-136-162.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-54bc6fdd74 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-54bc6fdd74

FailedCreate

Error creating: pods "router-default-54bc6fdd74-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-54bc6fdd74

FailedCreate

Error creating: pods "router-default-54bc6fdd74-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-54bc6fdd74

SuccessfulCreate

Created pod: router-default-54bc6fdd74-dstmh
(x6)

openshift-ingress

kubelet

router-default-54bc6fdd74-dstmh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-54bc6fdd74-dstmh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-54bc6fdd74-dstmh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-54bc6fdd74-dstmh

Created

Created container: router

openshift-ingress

kubelet

router-default-54bc6fdd74-dstmh

Started

Started container router

openshift-ingress

multus

router-default-54bc6fdd74-dstmh

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-jpqm6

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-js2tp

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-746c8b5fff

FailedCreate

Error creating: pods "kube-auth-proxy-746c8b5fff-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-746c8b5fff

SuccessfulCreate

Created pod: kube-auth-proxy-746c8b5fff-js2tp

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-746c8b5fff from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-746c8b5fff

SuccessfulCreate

Created pod: kube-auth-proxy-746c8b5fff-jpqm6

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-jpqm6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-js2tp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-746c8b5fff-jpqm6

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-746c8b5fff-js2tp

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-27gxt

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-27gxt

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-js2tp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.757s (2.757s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-jpqm6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-js2tp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-jpqm6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.66s (2.66s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-js2tp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-746c8b5fff-jpqm6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.583s (3.583s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.465s (4.465s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-p8nh5

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-j97pv

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-j97pv

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j97pv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j97pv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j97pv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.577s (2.577s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-j97pv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-27gxt

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-27gxt

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-vlz4j

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-fzzg5

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-qds2c

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fzzg5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qds2c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-qds2c

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-fzzg5

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qds2c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qds2c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fzzg5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qds2c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.429s (2.429s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fzzg5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fzzg5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.1s (2.1s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vlz4j

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-abfca2-openshift-default-5899596d56

SuccessfulCreate

Created pod: e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

openshift-ingress

deployment-controller

e2e-inf-a-abfca2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-abfca2-openshift-default-5899596d56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-abfca2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-abfca2

openshift-ingress

multus

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-abfca2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-abfca2-5c7b444475 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-abfca2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-abfca2-5d488f867d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-abfca2-5c7b444475

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-abfca2: serviceaccount "payload-processing-e2e-inf-a-abfca2" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-abfca2-5c7b444475

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-abfca2-5c7b444475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-abfca2: serviceaccount "payload-processing-e2e-inf-a-abfca2" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-0bd77b-openshift-default-67c9df4dc8

SuccessfulCreate

Created pod: e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.712s (1.712s including waiting). Image size: 166449337 bytes.

openshift-ingress

gateway_labeler_controller

e2e-autores-0bd77b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-0bd77b

openshift-ingress

deployment-controller

e2e-autores-0bd77b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-0bd77b-openshift-default-67c9df4dc8 from 0 to 1

openshift-ingress

multus

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-4e6230ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4e6230ad-openshift-default-77774c79c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-4e6230ad-openshift-default-77774c79c8

SuccessfulCreate

Created pod: e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

openshift-ingress

gateway_labeler_controller

e2e-ait-4e6230ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4e6230ad

openshift-ingress

multus

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-0bd77b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-0bd77b-6c464bbcbf from 0 to 1

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-0bd77b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-0bd77b-8bd69954 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0bd77b-6c464bbcbf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-0bd77b-6c464bbcbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0bd77b: serviceaccount "payload-processing-e2e-autores-0bd77b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0bd77b-6c464bbcbf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

openshift-ingress

multus

payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0bd77b-8bd69954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0bd77b-8bd69954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-0bd77b-8bd69954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0bd77b: serviceaccount "payload-processing-e2e-autores-0bd77b" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-80fb45

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-80fb45

openshift-ingress

deployment-controller

e2e-inf-b-80fb45-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-80fb45-openshift-default-5bd5d6894b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-80fb45-openshift-default-5bd5d6894b

SuccessfulCreate

Created pod: e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.509s (2.509s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-80fb45

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-80fb45-787b4f5c6f from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-80fb45-787b4f5c6f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-80fb45-787b4f5c6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-80fb45: serviceaccount "payload-processing-e2e-inf-b-80fb45" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-80fb45-787b4f5c6f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

openshift-ingress

kubelet

payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-80fb45

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-80fb45: serviceaccount "payload-processing-e2e-inf-b-80fb45" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

openshift-ingress

kubelet

payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4e6230ad: serviceaccount "payload-processing-e2e-ait-4e6230ad" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4e6230ad-596547944f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4e6230ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4e6230ad-bbc779f46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4e6230ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4e6230ad-596547944f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4e6230ad-596547944f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4e6230ad-596547944f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4e6230ad: serviceaccount "payload-processing-e2e-ait-4e6230ad" not found
(x5)

openshift-ingress

kubelet

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:57644->10.134.0.55:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": read tcp 10.134.0.2:57644->10.134.0.55:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-4e6230ad-openshift-default-77774c79c8-9qtfq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-4e6230ad-596547944f-qpg6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4e6230ad-bbc779f46-c6w8q

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-42670434-gw-openshift-default-647fcdc94d

SuccessfulCreate

Created pod: e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

openshift-ingress

deployment-controller

e2e-migrate-42670434-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-42670434-gw-openshift-default-647fcdc94d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-42670434-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-42670434-gw

openshift-ingress

multus

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-42670434-856bd87574

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-42670434-856bd87574-pdzds
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-42670434: serviceaccount "payload-processing-e2e-migrate-42670434" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-42670434

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-42670434

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-42670434-856bd87574 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-42670434-856bd87574

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-42670434-856bd87574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-42670434: serviceaccount "payload-processing-e2e-migrate-42670434" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-42670434-856bd87574-pdzds

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-42670434-856bd87574-pdzds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-42670434-856bd87574-pdzds

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-42670434-856bd87574-pdzds

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-42670434-856bd87574-pdzds

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-42670434-gw-openshift-default-647fcdc94d-rrd7h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-42670434-7cc48bd4fd-28pt6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-42670434

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-42670434: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-42670434": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-42670434, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a14e332c-6cba-4d4a-be88-8ea44f6c497d, UID in object meta:

openshift-ingress

deployment-controller

e2e-ait-383709f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-383709f1-openshift-default-59d9b996bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-383709f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-383709f1

openshift-ingress

replicaset-controller

e2e-ait-383709f1-openshift-default-59d9b996bb

SuccessfulCreate

Created pod: e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

openshift-ingress

multus

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-383709f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-383709f1-58d76669d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-383709f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-383709f1-65697f5bd6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-383709f1-65697f5bd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-383709f1-65697f5bd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-383709f1: serviceaccount "payload-processing-e2e-ait-383709f1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-383709f1-65697f5bd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-383709f1-58d76669d5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-383709f1-58d76669d5-mxtff
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-383709f1-58d76669d5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-383709f1-58d76669d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-383709f1: serviceaccount "payload-processing-e2e-ait-383709f1" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-383709f1-58d76669d5-mxtff

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-383709f1-58d76669d5-mxtff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-383709f1-58d76669d5-mxtff

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-383709f1-58d76669d5-mxtff

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-383709f1-65697f5bd6-plcjf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-383709f1-58d76669d5-mxtff

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-61f2ffc9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-61f2ffc9

openshift-ingress

deployment-controller

e2e-derive-61f2ffc9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d from 0 to 1

openshift-ingress

kubelet

e2e-ait-383709f1-openshift-default-59d9b996bb-4jqz6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d

SuccessfulCreate

Created pod: e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-61f2ffc9: serviceaccount "payload-processing-e2e-derive-61f2ffc9" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-61f2ffc9-6f846b66d9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-61f2ffc9-6f846b66d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-61f2ffc9: serviceaccount "payload-processing-e2e-derive-61f2ffc9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-61f2ffc9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-61f2ffc9-6f846b66d9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-61f2ffc9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-61f2ffc9-6f846b66d9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-0bd77b-6c464bbcbf-7bk4g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0bd77b-8bd69954-csndv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-explicit-25f5d3-openshift-default-5f6554c5d8

SuccessfulCreate

Created pod: e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-explicit-25f5d3

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-explicit-25f5d3-authn-ssl: envoyfilters.networking.istio.io "e2e-explicit-25f5d3-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-explicit-25f5d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-25f5d3

openshift-ingress

deployment-controller

e2e-explicit-25f5d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-25f5d3-openshift-default-5f6554c5d8 from 0 to 1

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-0bd77b-openshift-default-67c9df4dc8-tmg5f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-25f5d3-6d99c7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-25f5d3-6d99c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-25f5d3: serviceaccount "payload-processing-e2e-explicit-25f5d3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-25f5d3: serviceaccount "payload-processing-e2e-explicit-25f5d3" not found
(x5)

openshift-ingress

kubelet

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-25f5d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-25f5d3-6d99c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-25f5d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-25f5d3-6d99c7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

openshift-ingress

kubelet

payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-61f2ffc9-6f846b66d9-zz586

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-derive-61f2ffc9-openshift-default-6fc59c5b6d-ckdbn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-61f2ffc9-8688ddbfdb-gfdqf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-25f5d3-76d58fdbdb-4pq8w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-25f5d3-6d99c7-9gjh6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-25f5d3-openshift-default-5f6554c5d8-qw2kd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-f83766-openshift-default-67b9ff58fb

SuccessfulCreate

Created pod: e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

openshift-ingress

gateway_labeler_controller

e2e-noten-f83766

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f83766

openshift-ingress

deployment-controller

e2e-noten-f83766-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f83766-openshift-default-67b9ff58fb from 0 to 1

openshift-ingress

kubelet

e2e-noten-f83766-openshift-default-67b9ff58fb-5swhc

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-3e88320d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3e88320d-openshift-default-57674db98d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-3e88320d-openshift-default-57674db98d

SuccessfulCreate

Created pod: e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

openshift-ingress

gateway_labeler_controller

e2e-mt-3e88320d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3e88320d

openshift-ingress

multus

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-abfca2-5d488f867d-49gsh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3e88320d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3e88320d-5dd8646bbf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-abfca2-5c7b444475-bg8fm

Unhealthy

Readiness probe failed: dial tcp 10.134.0.53:9004: i/o timeout

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3e88320d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3e88320d: serviceaccount "payload-processing-e2e-mt-3e88320d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3e88320d-5dd8646bbf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3e88320d-5dd8646bbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3e88320d: serviceaccount "payload-processing-e2e-mt-3e88320d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3e88320d-5dd8646bbf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-abfca2-openshift-default-5899596d56-d48s9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-80fb45-6b59fcb6f8-mprgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-80fb45-787b4f5c6f-bjqhn

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w4-fb65d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w4-fb65d4

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w4-fb65d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb from 0 to 1

openshift-ingress

multus

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb

SuccessfulCreate

Created pod: e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-80fb45-openshift-default-5bd5d6894b-slk6n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w4-fb65d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w4-fb65d4-75c688654c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-fb65d4: serviceaccount "payload-processing-e2e-shared-a-w4-fb65d4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w4-fb65d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w4-fb65d4: serviceaccount "payload-processing-e2e-shared-a-w4-fb65d4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3e88320d-9dd4cd9d6-htgf8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3e88320d-5dd8646bbf-cgcnm

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-3e88320d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-3e88320d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-3e88320d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-3e88320d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2ffef573-7f53-4679-81f8-67c6838a7550, UID in object meta:

openshift-ingress

kubelet

e2e-mt-3e88320d-openshift-default-57674db98d-8bxf8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd

SuccessfulCreate

Created pod: e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

openshift-ingress

deployment-controller

e2e-shared-b-w4-261f9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w4-261f9c-openshift-default-6676676dcd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w4-261f9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w4-261f9c

openshift-ingress

multus

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-c52865-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c52865-openshift-default-bf8cf6976 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c52865

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c52865

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976

SuccessfulCreate

Created pod: e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

openshift-ingress

multus

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w4-261f9c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w4-261f9c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-261f9c: serviceaccount "payload-processing-e2e-shared-b-w4-261f9c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w4-261f9c: serviceaccount "payload-processing-e2e-shared-b-w4-261f9c" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c52865-594ffd9475

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c52865-594ffd9475-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c52865: serviceaccount "payload-processing-e2e-shared-a-w2-c52865" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c52865: serviceaccount "payload-processing-e2e-shared-a-w2-c52865" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c52865

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c52865

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c52865-594ffd9475 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c52865-594ffd9475

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

ProbeError

Readiness probe error: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Unhealthy

Readiness probe failed: Get "http://10.134.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-5cf565-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6

SuccessfulCreate

Created pod: e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-5cf565

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-5cf565

openshift-ingress

multus

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5cf565: serviceaccount "payload-processing-e2e-shared-b-w2-5cf565" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-5cf565: serviceaccount "payload-processing-e2e-shared-b-w2-5cf565" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-5cf565

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-5cf565

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-d630fb00

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d630fb00

openshift-ingress

replicaset-controller

e2e-mt-d630fb00-openshift-default-8f6b98456

SuccessfulCreate

Created pod: e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

openshift-ingress

deployment-controller

e2e-mt-d630fb00-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d630fb00-openshift-default-8f6b98456 from 0 to 1

openshift-ingress

multus

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d630fb00

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d630fb00-8bdb68ccc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d630fb00-8bdb68ccc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d630fb00-8bdb68ccc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d630fb00: serviceaccount "payload-processing-e2e-mt-d630fb00" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d630fb00

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d630fb00-667dc57b66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d630fb00-667dc57b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d630fb00-667dc57b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d630fb00-667dc57b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d630fb00: serviceaccount "payload-processing-e2e-mt-d630fb00" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d630fb00-8bdb68ccc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

openshift-ingress

multus

payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-d630fb00-8bdb68ccc-652dx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-d630fb00

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-d630fb00: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-d630fb00": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-d630fb00, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d1012397-ce98-460b-834d-2f1bc9d66726, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d630fb00-667dc57b66-9vbpf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-d630fb00-openshift-default-8f6b98456-vrcjl

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-api-a-17d457

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-a-17d457-authn-ssl: envoyfilters.networking.istio.io "e2e-api-a-17d457-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-api-a-17d457

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-17d457

openshift-ingress

deployment-controller

e2e-api-a-17d457-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-17d457-openshift-default-f97bdc56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-17d457-openshift-default-f97bdc56

SuccessfulCreate

Created pod: e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

openshift-ingress

multus

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-17d457-7cbb86c9d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-17d457-7cbb86c9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-17d457: serviceaccount "payload-processing-e2e-api-a-17d457" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-17d457

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-17d457-7cbb86c9d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-17d457

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-17d457-9756796f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-17d457-9756796f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-17d457-9756796f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-17d457: serviceaccount "payload-processing-e2e-api-a-17d457" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-17d457-7cbb86c9d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

openshift-ingress

multus

payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-17d457-9756796f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2
(x2)

openshift-ingress

kubelet

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-106468-openshift-default-7c4f4f8bbd

SuccessfulCreate

Created pod: e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

openshift-ingress

deployment-controller

e2e-api-b-106468-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-106468-openshift-default-7c4f4f8bbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-106468

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-106468

openshift-ingress

multus

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-106468-d9ff44cdc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-106468

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-106468-6dfc858dcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-106468

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-106468-d9ff44cdc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-106468-6dfc858dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-106468-6dfc858dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-106468-6dfc858dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-106468: serviceaccount "payload-processing-e2e-api-b-106468" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-106468-d9ff44cdc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-106468-d9ff44cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-106468: serviceaccount "payload-processing-e2e-api-b-106468" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-17d457-9756796f4-mxvm2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-17d457-7cbb86c9d7-xpc8l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-17d457-openshift-default-f97bdc56-h7f88

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-106468-d9ff44cdc-pcfh9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-106468-6dfc858dcd-jllf8

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e6521d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e6521d

openshift-ingress

replicaset-controller

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b

SuccessfulCreate

Created pod: e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

openshift-ingress

deployment-controller

e2e-ipp-a-e6521d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e6521d-openshift-default-5d6f56d69b from 0 to 1

openshift-ingress

multus

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-106468-openshift-default-7c4f4f8bbd-d9xs4

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e6521d-74b7f57c79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e6521d-74b7f57c79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e6521d-74b7f57c79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e6521d: serviceaccount "payload-processing-e2e-ipp-a-e6521d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e6521d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e6521d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e6521d-74b7f57c79 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e6521d: serviceaccount "payload-processing-e2e-ipp-a-e6521d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

Created

Created container: payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-c52865

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c52865: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-c52865": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c52865, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9f544eff-553b-431a-8eee-cd8d336d0396, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c52865-594ffd9475-7pfh4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c52865-dbb4db686-l5rwp

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-c52865-openshift-default-bf8cf6976-pcvjd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-b-d9cd47-openshift-default-746df77886

SuccessfulCreate

Created pod: e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

openshift-ingress

deployment-controller

e2e-ipp-b-d9cd47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d9cd47-openshift-default-746df77886 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d9cd47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d9cd47

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-d9cd47

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-d9cd47-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-d9cd47-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d9cd47: serviceaccount "payload-processing-e2e-ipp-b-d9cd47" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d9cd47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d9cd47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d9cd47-866dd74b9c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d9cd47: serviceaccount "payload-processing-e2e-ipp-b-d9cd47" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-5cf565-9d59475bb-svs6n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-5cf565-69fd7d4787-52t7n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-5cf565-openshift-default-67bf8c5bf6-59rdx

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-246a87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-246a87

openshift-ingress

deployment-controller

e2e-ipp-cleanup-246a87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-246a87: serviceaccount "payload-processing-e2e-ipp-cleanup-246a87" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-246a87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-246a87: serviceaccount "payload-processing-e2e-ipp-cleanup-246a87" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-246a87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-246a87-574dd9bf6c-l4htd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-246a87-549c67948b-d25bt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-246a87-openshift-default-676cdcdbbd-g9jtw

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-e6521d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-e6521d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-e6521d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-e6521d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ae2477ce-1eff-4e44-bb7d-1faa73c4f293, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e6521d-74b7f57c79-zf7bk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e6521d-66b4b7bd46-5rmfr

Unhealthy

Readiness probe failed: dial tcp 10.132.0.75:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-e6521d-openshift-default-5d6f56d69b-sjvrb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d9cd47-8dcc487f8-knbfc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d9cd47-866dd74b9c-8m65j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d9cd47-openshift-default-746df77886-btzh9

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w4-fb65d4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w4-fb65d4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w4-fb65d4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w4-fb65d4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6ccf5b0a-d69f-484c-bae8-ced0a857d679, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w4-fb65d4-548d457c66-kxfbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w4-fb65d4-75c688654c-x7nlg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w4-fb65d4-openshift-default-598f9df9cb-pfwxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w4-261f9c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w4-261f9c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w4-261f9c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w4-261f9c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 438c8e02-83ba-4597-9937-bec4a63b8746, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w4-261f9c-8497b9c6d6-qfrxr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w4-261f9c-7586f6f79c-kklxj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w4-261f9c-openshift-default-6676676dcd-rpc8k

Killing

Stopping container istio-proxy