Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-mt-99719fde-openshift-default-595b55748-pjw89

Scheduled

Successfully assigned openshift-ingress/e2e-mt-99719fde-openshift-default-595b55748-pjw89 to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6 to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5 to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7 to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67 to ip-10-0-128-15.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-btzhg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-btzhg to ip-10-0-134-104.ec2.internal

openshift-ingress

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6b2abe85-b86f59889-5j527

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6b2abe85-b86f59889-5j527 to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd to ip-10-0-134-104.ec2.internal

openshift-ingress

e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d9afa3-openshift-default-f8849555b-zg5df to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-2wlv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-2wlv5 to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298 to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr to ip-10-0-128-15.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-p4swv

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-p4swv to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-76a88377-86847f66c7-v97bw to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6 to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4 to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z to ip-10-0-134-104.ec2.internal

openshift-ingress

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44 to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-c686d0-openshift-default-79744f8746-j49hw to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb to ip-10-0-128-15.ec2.internal

openshift-ingress

kube-auth-proxy-5dc8ddcd98-zgj6j

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5dc8ddcd98-zgj6j to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8 to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28 to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6 to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd to ip-10-0-141-17.ec2.internal

openshift-ingress

kube-auth-proxy-5dc8ddcd98-hvz5n

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5dc8ddcd98-hvz5n to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k to ip-10-0-141-17.ec2.internal

openshift-ingress

router-default-85cf78879b-z2qnj

Scheduled

Successfully assigned openshift-ingress/router-default-85cf78879b-z2qnj to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4 to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5 to ip-10-0-141-17.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-gv5kp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-gv5kp to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Scheduled

Successfully assigned openshift-ingress/e2e-autores-28eba6-openshift-default-544d775478-s6m9w to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4 to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc to ip-10-0-134-104.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78 to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-autores-28eba6-bcd474885-2szsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-28eba6-bcd474885-2szsq to ip-10-0-128-15.ec2.internal

openshift-ingress

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6 to ip-10-0-128-15.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-wwmzb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wwmzb to ip-10-0-128-15.ec2.internal

openshift-ingress

payload-processing-e2e-mt-70207142-6655594565-tgrt9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-70207142-6655594565-tgrt9 to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5 to ip-10-0-141-17.ec2.internal

openshift-ingress

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Scheduled

Successfully assigned openshift-ingress/e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk to ip-10-0-141-17.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5 to ip-10-0-128-15.ec2.internal
(x5)

openshift-ingress

replicaset-controller

router-default-85cf78879b

FailedCreate

Error creating: pods "router-default-85cf78879b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-85cf78879b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-85cf78879b

FailedCreate

Error creating: pods "router-default-85cf78879b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-85cf78879b

SuccessfulCreate

Created pod: router-default-85cf78879b-z2qnj
(x6)

openshift-ingress

kubelet

router-default-85cf78879b-z2qnj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-85cf78879b-z2qnj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-85cf78879b-z2qnj

Created

Created container: router

openshift-ingress

multus

router-default-85cf78879b-z2qnj

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-85cf78879b-z2qnj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-85cf78879b-z2qnj

Started

Started container router
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5dc8ddcd98

FailedCreate

Error creating: pods "kube-auth-proxy-5dc8ddcd98-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5dc8ddcd98 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5dc8ddcd98

SuccessfulCreate

Created pod: kube-auth-proxy-5dc8ddcd98-zgj6j

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-hvz5n

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-zgj6j

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-5dc8ddcd98

SuccessfulCreate

Created pod: kube-auth-proxy-5dc8ddcd98-hvz5n

openshift-ingress

multus

kube-auth-proxy-5dc8ddcd98-zgj6j

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5dc8ddcd98-hvz5n

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-wwmzb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-wwmzb

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wwmzb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-zgj6j

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-zgj6j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.856s (2.856s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-hvz5n

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-hvz5n

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-zgj6j

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5dc8ddcd98-hvz5n

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.75s (2.75s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wwmzb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wwmzb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.165s (3.165s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wwmzb

Created

Created container: discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-gv5kp

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-gv5kp

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gv5kp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 14.848s (14.848s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gv5kp

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gv5kp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.388s (3.388s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gv5kp

Created

Created container: discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

Unhealthy

Startup probe failed: Get "http://10.133.0.20:15021/healthz/ready": dial tcp 10.133.0.20:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-27hrz

ProbeError

Startup probe error: Get "http://10.133.0.20:15021/healthz/ready": dial tcp 10.133.0.20:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-wwmzb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wwmzb

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-p4swv

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-p4swv

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-2wlv5
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-btzhg

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-btzhg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2wlv5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-btzhg

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-2wlv5

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2wlv5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.956s (2.956s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-btzhg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.025s (3.025s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-btzhg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2wlv5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2wlv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-btzhg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4swv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4swv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4swv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4swv

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-p4swv

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-849b71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-849b71

openshift-ingress

deployment-controller

e2e-worker-w4-c86e9a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-worker-w0-849b71

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-worker-w0-849b71-authn-ssl: envoyfilters.networking.istio.io "e2e-worker-w0-849b71-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-inf-a-449c47-openshift-default-6f85596644

SuccessfulCreate

Created pod: e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-c86e9a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-c86e9a

openshift-ingress

deployment-controller

e2e-inf-a-449c47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-449c47-openshift-default-6f85596644 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-449c47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-449c47

openshift-ingress

replicaset-controller

e2e-worker-w0-849b71-openshift-default-77697b697d

SuccessfulCreate

Created pod: e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

openshift-ingress

deployment-controller

e2e-worker-w0-849b71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-849b71-openshift-default-77697b697d from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b

SuccessfulCreate

Created pod: e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

openshift-ingress

multus

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-c86e9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-c86e9a-d5b9884b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c86e9a: serviceaccount "payload-processing-e2e-worker-w4-c86e9a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-c86e9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-c86e9a: serviceaccount "payload-processing-e2e-worker-w4-c86e9a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-449c47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-449c47-56b675594b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-449c47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-449c47-85fcd6c879 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-449c47-56b675594b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-449c47-56b675594b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-449c47-56b675594b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-449c47: serviceaccount "payload-processing-e2e-inf-a-449c47" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-449c47-85fcd6c879

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-449c47-85fcd6c879-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-449c47: serviceaccount "payload-processing-e2e-inf-a-449c47" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-449c47-85fcd6c879

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-28eba6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-28eba6

openshift-ingress

replicaset-controller

e2e-autores-28eba6-openshift-default-544d775478

SuccessfulCreate

Created pod: e2e-autores-28eba6-openshift-default-544d775478-s6m9w

openshift-ingress

multus

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-28eba6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-28eba6-openshift-default-544d775478 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 8.679s (8.679s including waiting). Image size: 181318953 bytes.

openshift-ingress

gateway_labeler_controller

e2e-ait-76a88377

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-76a88377

openshift-ingress

deployment-controller

e2e-ait-76a88377-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-76a88377-openshift-default-67587b76f4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-76a88377-openshift-default-67587b76f4

SuccessfulCreate

Created pod: e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.497s (1.497s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.48s (1.48s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

Created

Created container: payload-processing

openshift-ingress

multus

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-849b71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-849b71-77497df66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-849b71-77497df66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-849b71-77497df66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-849b71-77497df66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-849b71: serviceaccount "payload-processing-e2e-worker-w0-849b71" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-849b71-6848bc846f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-849b71-6848bc846f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-849b71: serviceaccount "payload-processing-e2e-worker-w0-849b71" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-849b71-6848bc846f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-849b71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-849b71-6848bc846f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-28eba6-bcd474885

SuccessfulCreate

Created pod: payload-processing-e2e-autores-28eba6-bcd474885-2szsq

openshift-ingress

deployment-controller

payload-processing-e2e-autores-28eba6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-28eba6-bcd474885 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-28eba6-bcd474885

FailedCreate

Error creating: pods "payload-processing-e2e-autores-28eba6-bcd474885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-28eba6: serviceaccount "payload-processing-e2e-autores-28eba6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-28eba6: serviceaccount "payload-processing-e2e-autores-28eba6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-28eba6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-28eba6-5cbfdb995d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-28eba6-bcd474885-2szsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-28eba6-bcd474885-2szsq

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-28eba6-bcd474885-2szsq

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-28eba6-bcd474885-2szsq

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-inf-b-a2dc23-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a2dc23-openshift-default-57d9c95d8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a2dc23

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a2dc23

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Unhealthy

Readiness probe failed: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

ProbeError

Readiness probe error: Get "http://10.133.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b

SuccessfulCreate

Created pod: e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

openshift-ingress

multus

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-76a88377

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-76a88377-86847f66c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-76a88377-86847f66c7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-76a88377

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-76a88377-746f8dc854 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-76a88377-746f8dc854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-76a88377-746f8dc854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-76a88377: serviceaccount "payload-processing-e2e-ait-76a88377" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-76a88377-746f8dc854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-76a88377-86847f66c7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-76a88377-86847f66c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-76a88377: serviceaccount "payload-processing-e2e-ait-76a88377" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.174s (1.174s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a2dc23: serviceaccount "payload-processing-e2e-inf-b-a2dc23" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a2dc23: serviceaccount "payload-processing-e2e-inf-b-a2dc23" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a2dc23

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a2dc23

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a2dc23-75d74fb8d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": read tcp 10.133.0.2:54846->10.133.0.38:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": read tcp 10.133.0.2:54846->10.133.0.38:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-76a88377-746f8dc854-8jvxm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-76a88377-86847f66c7-v97bw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-49b90ab7-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd

SuccessfulCreate

Created pod: e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

openshift-ingress

multus

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-49b90ab7-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-49b90ab7-gw

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-76a88377-openshift-default-67587b76f4-gzgtx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-49b90ab7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-49b90ab7-7675f79c54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-49b90ab7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-49b90ab7: serviceaccount "payload-processing-e2e-migrate-49b90ab7" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-49b90ab7-7675f79c54

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-49b90ab7-7675f79c54

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-49b90ab7-7675f79c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-49b90ab7: serviceaccount "payload-processing-e2e-migrate-49b90ab7" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-49b90ab7-gw-openshift-default-65bc6f64dd-fjg7r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-49b90ab7-7675f79c54-2ln4r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-49b90ab7-577ff9545d-h762k

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-6b2abe85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6b2abe85

openshift-ingress

deployment-controller

e2e-ait-6b2abe85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6b2abe85-openshift-default-5f8fc7b478 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-6b2abe85-openshift-default-5f8fc7b478

SuccessfulCreate

Created pod: e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

openshift-ingress

multus

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6b2abe85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6b2abe85-b86f59889

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6b2abe85-b86f59889-5j527
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6b2abe85-b86f59889

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6b2abe85-b86f59889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6b2abe85: serviceaccount "payload-processing-e2e-ait-6b2abe85" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6b2abe85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6b2abe85-b86f59889 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6b2abe85: serviceaccount "payload-processing-e2e-ait-6b2abe85" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-6b2abe85-b86f59889-5j527

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6b2abe85-b86f59889-5j527

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6b2abe85-b86f59889-5j527

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6b2abe85-b86f59889-5j527

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

Started

Started container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-28eba6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-28eba6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-28eba6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-28eba6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18ce7cab-14e0-4e98-bf78-42867872240f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-28eba6-5cbfdb995d-rncwd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-28eba6-bcd474885-2szsq

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6b2abe85-5b959dffcd-rp26x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6b2abe85-b86f59889-5j527

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-6b2abe85-openshift-default-5f8fc7b478-4snzt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-23da8b90-openshift-default-5c55dcc496

SuccessfulCreate

Created pod: e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

openshift-ingress

deployment-controller

e2e-derive-23da8b90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-23da8b90-openshift-default-5c55dcc496 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-23da8b90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-23da8b90

openshift-ingress

multus

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-23da8b90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-23da8b90-7b9cb4bd77 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-23da8b90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-23da8b90: serviceaccount "payload-processing-e2e-derive-23da8b90" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-23da8b90-7b9cb4bd77

FailedCreate

Error creating: pods "payload-processing-e2e-derive-23da8b90-7b9cb4bd77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-23da8b90: serviceaccount "payload-processing-e2e-derive-23da8b90" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-23da8b90-7b9cb4bd77

SuccessfulCreate

Created pod: payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

openshift-ingress

kubelet

payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-explicit-5b08fa-openshift-default-7bffc6fc6

SuccessfulCreate

Created pod: e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

openshift-ingress

deployment-controller

e2e-explicit-5b08fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-5b08fa-openshift-default-7bffc6fc6 from 0 to 1

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-5b08fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-5b08fa

openshift-ingress

multus

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-5b08fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-5b08fa-787896c79d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5b08fa-848bcd5f5c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-5b08fa-848bcd5f5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5b08fa: serviceaccount "payload-processing-e2e-explicit-5b08fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5b08fa-848bcd5f5c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-5b08fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-5b08fa-848bcd5f5c from 0 to 1

openshift-ingress

kubelet

e2e-autores-28eba6-openshift-default-544d775478-s6m9w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5b08fa-787896c79d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-5b08fa-787896c79d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5b08fa: serviceaccount "payload-processing-e2e-explicit-5b08fa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5b08fa-787896c79d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-23da8b90-54b7b6d9fd-p7f2d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-23da8b90-7b9cb4bd77-gp6mt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-23da8b90-openshift-default-5c55dcc496-8rkfk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5b08fa-787896c79d-8pvtq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-5b08fa-848bcd5f5c-454kj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-5b08fa-openshift-default-7bffc6fc6-4z47n

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-d9afa3-openshift-default-f8849555b

SuccessfulCreate

Created pod: e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

openshift-ingress

deployment-controller

e2e-noten-d9afa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d9afa3-openshift-default-f8849555b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-d9afa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d9afa3

openshift-ingress

multus

e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-70207142-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-70207142-openshift-default-7b9c79db96 from 0 to 1

openshift-ingress

multus

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-70207142-openshift-default-7b9c79db96

SuccessfulCreate

Created pod: e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

openshift-ingress

gateway_labeler_controller

e2e-mt-70207142

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-70207142

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-70207142-6655594565

SuccessfulCreate

Created pod: payload-processing-e2e-mt-70207142-6655594565-tgrt9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-70207142-d64f9fdbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-70207142-d64f9fdbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-70207142: serviceaccount "payload-processing-e2e-mt-70207142" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-70207142-d64f9fdbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

openshift-ingress

deployment-controller

payload-processing-e2e-mt-70207142

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-70207142-6655594565 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-70207142-6655594565

FailedCreate

Error creating: pods "payload-processing-e2e-mt-70207142-6655594565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-70207142: serviceaccount "payload-processing-e2e-mt-70207142" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-70207142

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-70207142-d64f9fdbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-70207142-6655594565-tgrt9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-70207142-6655594565-tgrt9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-70207142-6655594565-tgrt9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-70207142-6655594565-tgrt9

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-70207142-d64f9fdbb-lhrlf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-70207142-6655594565-tgrt9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-70207142-openshift-default-7b9c79db96-n4tj6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96

SuccessfulCreate

Created pod: e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-2b23c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-2b23c7

openshift-ingress

deployment-controller

e2e-shared-a-w2-2b23c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-449c47-56b675594b-42djr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-449c47-85fcd6c879-8r6wp

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-d9afa3-openshift-default-f8849555b-zg5df

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-2b23c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2b23c7: serviceaccount "payload-processing-e2e-shared-a-w2-2b23c7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-2b23c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-2b23c7: serviceaccount "payload-processing-e2e-shared-a-w2-2b23c7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-w2-608b97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-608b97-openshift-default-7854df5c76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-608b97-openshift-default-7854df5c76

SuccessfulCreate

Created pod: e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-608b97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-608b97

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-608b97

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-608b97-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-608b97-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-608b97: serviceaccount "payload-processing-e2e-shared-b-w2-608b97" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-608b97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-608b97-55586b7455 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-608b97-55586b7455

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-608b97-55586b7455

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-608b97-55586b7455-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-608b97: serviceaccount "payload-processing-e2e-shared-b-w2-608b97" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-608b97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-449c47-openshift-default-6f85596644-gwlzr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a2dc23-78cf4988d6-n4dc8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a2dc23-75d74fb8d5-4zzs7

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-99719fde-openshift-default-595b55748

SuccessfulCreate

Created pod: e2e-mt-99719fde-openshift-default-595b55748-pjw89

openshift-ingress

deployment-controller

e2e-mt-99719fde-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-99719fde-openshift-default-595b55748 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-99719fde

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-99719fde

openshift-ingress

multus

e2e-mt-99719fde-openshift-default-595b55748-pjw89

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-a2dc23-openshift-default-57d9c95d8b-hqppx

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-1d63c0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98

SuccessfulCreate

Created pod: e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1d63c0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1d63c0

openshift-ingress

multus

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-99719fde

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-99719fde

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-99719fde-5f7f756785 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-99719fde: serviceaccount "payload-processing-e2e-mt-99719fde" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-99719fde-5f7f756785

FailedCreate

Error creating: pods "payload-processing-e2e-mt-99719fde-5f7f756785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-99719fde: serviceaccount "payload-processing-e2e-mt-99719fde" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-99719fde-5f7f756785

SuccessfulCreate

Created pod: payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

openshift-ingress

kubelet

payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1d63c0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1d63c0: serviceaccount "payload-processing-e2e-shared-a-w3-1d63c0" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1d63c0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1d63c0: serviceaccount "payload-processing-e2e-shared-a-w3-1d63c0" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-99719fde-openshift-default-595b55748-pjw89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-99719fde-openshift-default-595b55748-pjw89

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-99719fde-openshift-default-595b55748-pjw89

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-99719fde-openshift-default-595b55748-pjw89

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-99719fde-openshift-default-595b55748-pjw89

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774

SuccessfulCreate

Created pod: e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

openshift-ingress

deployment-controller

e2e-shared-b-w3-5818c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5818c9-openshift-default-57d9b65774 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5818c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5818c9

openshift-ingress

multus

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5818c9: serviceaccount "payload-processing-e2e-shared-b-w3-5818c9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5818c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5818c9: serviceaccount "payload-processing-e2e-shared-b-w3-5818c9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5818c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5818c9-658fb58cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-99719fde

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-99719fde: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-99719fde": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-99719fde, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6bb28564-bc4a-4c41-a201-e15f1ab3c94a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-99719fde-7f4f8bcbf8-zdtq4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-99719fde-5f7f756785-6xwlj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-99719fde-openshift-default-595b55748-pjw89

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-c686d0-openshift-default-79744f8746

SuccessfulCreate

Created pod: e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

openshift-ingress

gateway_labeler_controller

e2e-api-a-c686d0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-c686d0

openshift-ingress

deployment-controller

e2e-api-a-c686d0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-c686d0-openshift-default-79744f8746 from 0 to 1

openshift-ingress

multus

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-c86e9a-d5b9884b7-g4k7z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-c86e9a-bbb5599b6-fkwzc

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c686d0-6cb5f97c97

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c686d0: serviceaccount "payload-processing-e2e-api-a-c686d0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-c686d0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-c686d0-6cb5f97c97

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-c686d0-6cb5f97c97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-c686d0: serviceaccount "payload-processing-e2e-api-a-c686d0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-c686d0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-c686d0-6cb5f97c97 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-c86e9a-openshift-default-f7dc6cb5b-p4298

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-849b71-6848bc846f-lr6r6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-849b71-77497df66-xs6c5

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-8f99a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8f99a1

openshift-ingress

deployment-controller

e2e-api-b-8f99a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8f99a1-openshift-default-6bcdbf8f66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66

SuccessfulCreate

Created pod: e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

openshift-ingress

multus

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-849b71-openshift-default-77697b697d-9sn6c

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8f99a1: serviceaccount "payload-processing-e2e-api-b-8f99a1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8f99a1-ddc447dd5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8f99a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8f99a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8f99a1-ddc447dd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8f99a1-ddc447dd5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8f99a1-ddc447dd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8f99a1: serviceaccount "payload-processing-e2e-api-b-8f99a1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Unhealthy

Readiness probe failed: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

ProbeError

Readiness probe error: Get "http://10.133.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

ProbeError

Startup probe error: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Unhealthy

Startup probe failed: Get "http://10.133.0.87:15021/healthz/ready": dial tcp 10.133.0.87:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-c686d0-6cb5f97c97-c7lfx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-c686d0-795fb6fbf4-89dv5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-c686d0-openshift-default-79744f8746-j49hw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-8f99a1-ddc447dd5-8cplt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8f99a1-5d9d85dfc8-kpl67

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-8f99a1-openshift-default-6bcdbf8f66-4qmrd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-2b23c7-794bd6cbdb-x87nr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-2b23c7-5c986fff67-kxdmw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-2b23c7-openshift-default-9784d7d96-zdq2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-608b97-55586b7455-7v2wg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-608b97-5c94c45554-dxr78

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-608b97-openshift-default-7854df5c76-rhrcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-420219

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-420219

openshift-ingress

deployment-controller

e2e-ipp-a-420219-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-420219-openshift-default-57c96d9858 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-420219-openshift-default-57c96d9858

SuccessfulCreate

Created pod: e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-420219

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-420219-5798975b54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-420219-5798975b54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-420219-5798975b54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-420219-5798975b54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-420219: serviceaccount "payload-processing-e2e-ipp-a-420219" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-420219-68dd79d9fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-420219-68dd79d9fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-420219: serviceaccount "payload-processing-e2e-ipp-a-420219" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-420219-68dd79d9fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-420219

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-420219-68dd79d9fc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-ddedf5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-ddedf5

openshift-ingress

replicaset-controller

e2e-ipp-b-ddedf5-openshift-default-65969f687b

SuccessfulCreate

Created pod: e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

openshift-ingress

deployment-controller

e2e-ipp-b-ddedf5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-ddedf5-openshift-default-65969f687b from 0 to 1

openshift-ingress

multus

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ddedf5-78c48df79f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ddedf5: serviceaccount "payload-processing-e2e-ipp-b-ddedf5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-ddedf5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-ddedf5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-ddedf5-78c48df79f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-ddedf5-78c48df79f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-ddedf5-78c48df79f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-ddedf5: serviceaccount "payload-processing-e2e-ipp-b-ddedf5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Unhealthy

Readiness probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

ProbeError

Readiness probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448

SuccessfulCreate

Created pod: e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-ec94ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-ec94ed

openshift-ingress

deployment-controller

e2e-ipp-cleanup-ec94ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-ec94ed-openshift-default-5999db448 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-ec94ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ec94ed: serviceaccount "payload-processing-e2e-ipp-cleanup-ec94ed" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ec94ed: serviceaccount "payload-processing-e2e-ipp-cleanup-ec94ed" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-ec94ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ec94ed-7997898fb7-67jf5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ec94ed-7696c974b-szwl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-ec94ed-openshift-default-5999db448-2c5ln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-420219-5798975b54-mgt28

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-420219-68dd79d9fc-29pn4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-420219-openshift-default-57c96d9858-pz7lb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-ddedf5-6c8f8dd5d6-87dpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-ddedf5-78c48df79f-lxd9z

Unhealthy

Readiness probe failed: dial tcp 10.132.0.66:9004: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-b-ddedf5-openshift-default-65969f687b-m9msf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1d63c0-688db5c6c7-wdbhk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1d63c0-797f5f5cc4-kzcs4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-1d63c0-openshift-default-5cfd596f98-dfj44

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5818c9-658fb58cc-l7bhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5818c9-7cb659ddd6-kszc6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5818c9-openshift-default-57d9b65774-8cpk5

Killing

Stopping container istio-proxy