Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4 to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-c7wsb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-c7wsb to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7 to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2 to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822 to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5 to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85 to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7aab97-99945f649-7bmqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7aab97-99945f649-7bmqx to ip-10-0-132-205.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-hx8sl

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-hx8sl to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

Scheduled

Successfully assigned openshift-ingress/e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb to ip-10-0-130-123.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9 to ip-10-0-132-205.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6ht74

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6ht74 to ip-10-0-132-11.ec2.internal

openshift-ingress

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-000f34a9-openshift-default-578664bb88-chl5t to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z to ip-10-0-130-123.ec2.internal

openshift-ingress

kube-auth-proxy-7cb7b7df59-cm6xg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7cb7b7df59-cm6xg to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575 to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88 to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84 to ip-10-0-130-123.ec2.internal

openshift-ingress

kube-auth-proxy-7cb7b7df59-zgxzz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7cb7b7df59-zgxzz to ip-10-0-132-11.ec2.internal

openshift-ingress

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-000f34a9-686c44d485-s2svn to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9 to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs to ip-10-0-130-123.ec2.internal

openshift-ingress

router-default-84988c94c6-fp8j5

Scheduled

Successfully assigned openshift-ingress/router-default-84988c94c6-fp8j5 to ip-10-0-132-11.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m to ip-10-0-130-123.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cqcn9 to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Scheduled

Successfully assigned openshift-ingress/e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6 to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-9twnd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-9twnd to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf to ip-10-0-132-205.ec2.internal

openshift-ingress

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn to ip-10-0-130-123.ec2.internal

openshift-ingress

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj to ip-10-0-130-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t to ip-10-0-132-205.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b to ip-10-0-130-123.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-84988c94c6 from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-84988c94c6

FailedCreate

Error creating: pods "router-default-84988c94c6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-84988c94c6

FailedCreate

Error creating: pods "router-default-84988c94c6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-84988c94c6

SuccessfulCreate

Created pod: router-default-84988c94c6-fp8j5
(x5)

openshift-ingress

kubelet

router-default-84988c94c6-fp8j5

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-84988c94c6-fp8j5

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-84988c94c6-fp8j5

AddedInterface

Add eth0 [10.132.0.13/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-84988c94c6-fp8j5

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-84988c94c6-fp8j5

Started

Started container router

openshift-ingress

kubelet

router-default-84988c94c6-fp8j5

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7cb7b7df59 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7cb7b7df59

SuccessfulCreate

Created pod: kube-auth-proxy-7cb7b7df59-cm6xg

openshift-ingress

replicaset-controller

kube-auth-proxy-7cb7b7df59

SuccessfulCreate

Created pod: kube-auth-proxy-7cb7b7df59-zgxzz
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-7cb7b7df59

FailedCreate

Error creating: pods "kube-auth-proxy-7cb7b7df59-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-7cb7b7df59-cm6xg

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-cm6xg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-zgxzz

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6ht74

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-zgxzz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6ht74

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

kube-auth-proxy-7cb7b7df59-zgxzz

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-zgxzz

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-cm6xg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.747s (2.747s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-zgxzz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.519s (2.519s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-cm6xg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-zgxzz

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7cb7b7df59-cm6xg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.891s (3.891s including waiting). Image size: 181126104 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.238s (3.238s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zpl4n

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-hx8sl

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hx8sl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-hx8sl

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hx8sl

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hx8sl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.57s (2.57s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hx8sl

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hx8sl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hx8sl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6ht74

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6ht74

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-cqcn9

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.814s (2.814s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-c7wsb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-c7wsb

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-9twnd

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9twnd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-c7wsb

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-9twnd

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9twnd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9twnd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9twnd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.209s (1.209s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-c7wsb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-c7wsb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-c7wsb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.556s (3.556s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

ProbeError

Readiness probe error: Get "http://10.133.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Unhealthy

Readiness probe failed: Get "http://10.133.0.23:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

ProbeError

Startup probe error: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cqcn9

Unhealthy

Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w0-99c616-openshift-default-54d44b8c68

SuccessfulCreate

Created pod: e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

openshift-ingress

multus

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-99c616

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-99c616

openshift-ingress

deployment-controller

e2e-worker-w0-99c616-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-99c616-openshift-default-54d44b8c68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58

SuccessfulCreate

Created pod: e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

openshift-ingress

deployment-controller

e2e-worker-w4-8e5935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-8e5935

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-8e5935

openshift-ingress

multus

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a36bf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a36bf3

openshift-ingress

deployment-controller

e2e-inf-a-a36bf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a36bf3-openshift-default-6fd54959fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-a36bf3-openshift-default-6fd54959fb

SuccessfulCreate

Created pod: e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-99c616: serviceaccount "payload-processing-e2e-worker-w0-99c616" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-99c616-d9d7d7747

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-99c616-d9d7d7747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-99c616: serviceaccount "payload-processing-e2e-worker-w0-99c616" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-99c616-d9d7d7747

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-99c616

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-99c616

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-99c616-d9d7d7747 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8e5935: serviceaccount "payload-processing-e2e-worker-w4-8e5935" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-8e5935

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8e5935-d88d756f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-8e5935-d88d756f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-8e5935: serviceaccount "payload-processing-e2e-worker-w4-8e5935" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-8e5935-d88d756f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-8e5935

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-8e5935-d88d756f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a36bf3-86d9747967

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a36bf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a36bf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a36bf3-86d9747967 from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-e3d76dcd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e3d76dcd-openshift-default-8466dd7d8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a36bf3: serviceaccount "payload-processing-e2e-inf-a-a36bf3" not found

openshift-ingress

gateway_labeler_controller

e2e-ait-e3d76dcd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e3d76dcd

openshift-ingress

replicaset-controller

e2e-ait-e3d76dcd-openshift-default-8466dd7d8

SuccessfulCreate

Created pod: e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a36bf3-86d9747967

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a36bf3-86d9747967-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a36bf3: serviceaccount "payload-processing-e2e-inf-a-a36bf3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-bc2e37

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-bc2e37

openshift-ingress

replicaset-controller

e2e-autores-bc2e37-openshift-default-7d776c56fd

SuccessfulCreate

Created pod: e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

openshift-ingress

deployment-controller

e2e-autores-bc2e37-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-bc2e37-openshift-default-7d776c56fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

Started

Started container payload-pre-processing

openshift-ingress

multus

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e3d76dcd: serviceaccount "payload-processing-e2e-ait-e3d76dcd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e3d76dcd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e3d76dcd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e3d76dcd-ff7c5dd59 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e3d76dcd: serviceaccount "payload-processing-e2e-ait-e3d76dcd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-bc2e37

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-bc2e37-7595887f8b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-bc2e37-59bc788665

FailedCreate

Error creating: pods "payload-processing-e2e-autores-bc2e37-59bc788665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-bc2e37: serviceaccount "payload-processing-e2e-autores-bc2e37" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-bc2e37-7595887f8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-bc2e37-7595887f8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-bc2e37: serviceaccount "payload-processing-e2e-autores-bc2e37" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-bc2e37-7595887f8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

openshift-ingress

multus

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-bc2e37

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-bc2e37-59bc788665 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-bc2e37-59bc788665

SuccessfulCreate

Created pod: payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

openshift-ingress

kubelet

payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-b-321811-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-321811-openshift-default-7bfdf4974d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-321811

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-321811
(x6)

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-321811-openshift-default-7bfdf4974d

SuccessfulCreate

Created pod: e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m
(x5)

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-321811

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-321811-6bd5b9789d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-321811

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-321811-c87f9db8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-321811-c87f9db8c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-321811-c87f9db8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-321811: serviceaccount "payload-processing-e2e-inf-b-321811" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-321811: serviceaccount "payload-processing-e2e-inf-b-321811" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-321811-c87f9db8c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-e3d76dcd-ff7c5dd59-rj8gr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e3d76dcd-6bcc677f4b-cp9bj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e3d76dcd-openshift-default-8466dd7d8-j29sn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-b766dd7c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b766dd7c-gw

openshift-ingress

deployment-controller

e2e-migrate-b766dd7c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd

SuccessfulCreate

Created pod: e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

openshift-ingress

multus

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b766dd7c-855b6d68bb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b766dd7c: serviceaccount "payload-processing-e2e-migrate-b766dd7c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b766dd7c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b766dd7c-855b6d68bb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b766dd7c-855b6d68bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b766dd7c: serviceaccount "payload-processing-e2e-migrate-b766dd7c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b766dd7c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b766dd7c-855b6d68bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-b766dd7c-855b6d68bb-7jx88

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b766dd7c-596f67f6fd-6c822

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-91e5cec3-openshift-default-744fbfc79b

SuccessfulCreate

Created pod: e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

openshift-ingress

deployment-controller

e2e-ait-91e5cec3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-91e5cec3-openshift-default-744fbfc79b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-91e5cec3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-91e5cec3

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-b766dd7c-gw-openshift-default-dockercfg-64q9v); attempting to pull the image may not succeed.

openshift-ingress

multus

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-b766dd7c-gw-openshift-default-66dfd57bdd-82m2z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-91e5cec3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-91e5cec3-7557856b7f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-91e5cec3-7557856b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-91e5cec3: serviceaccount "payload-processing-e2e-ait-91e5cec3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-91e5cec3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-91e5cec3-7557856b7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-91e5cec3-7557856b7f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-91e5cec3: serviceaccount "payload-processing-e2e-ait-91e5cec3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-91e5cec3-b44cb79c8-zdpwf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-91e5cec3-7557856b7f-n4m7c

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-b351ffdb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b351ffdb

openshift-ingress

kubelet

e2e-ait-91e5cec3-openshift-default-744fbfc79b-rhmq8

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-b351ffdb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b351ffdb-openshift-default-68b8889856 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b351ffdb-openshift-default-68b8889856

SuccessfulCreate

Created pod: e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

openshift-ingress

multus

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b351ffdb-c4dbb7c69

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b351ffdb-c4dbb7c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b351ffdb: serviceaccount "payload-processing-e2e-derive-b351ffdb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b351ffdb-c4dbb7c69

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b351ffdb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b351ffdb-c4dbb7c69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b351ffdb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b351ffdb-597755f666 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b351ffdb-597755f666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b351ffdb-597755f666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b351ffdb-597755f666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b351ffdb: serviceaccount "payload-processing-e2e-derive-b351ffdb" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-bc2e37-59bc788665-wlz4r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bc2e37-7595887f8b-m5wvh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-bc2e37

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-bc2e37: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-bc2e37": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-bc2e37, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0d7cc233-939c-423c-ba76-c971eca3b7ad, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b351ffdb-597755f666-7ffl9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-b351ffdb-openshift-default-68b8889856-jdwrp

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-b351ffdb-c4dbb7c69-mh8db

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-7aab97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7aab97

openshift-ingress

deployment-controller

e2e-explicit-7aab97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7aab97-openshift-default-7f96b887cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-7aab97-openshift-default-7f96b887cb

SuccessfulCreate

Created pod: e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-bc2e37-openshift-default-7d776c56fd-f4wmq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7aab97-5496776878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7aab97-5496776878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7aab97-5496776878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7aab97: serviceaccount "payload-processing-e2e-explicit-7aab97" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7aab97-99945f649

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7aab97-99945f649-7bmqx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7aab97-99945f649

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7aab97-99945f649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7aab97: serviceaccount "payload-processing-e2e-explicit-7aab97" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7aab97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7aab97-99945f649 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7aab97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7aab97-5496776878 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7aab97-99945f649-7bmqx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7aab97-99945f649-7bmqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7aab97-99945f649-7bmqx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-7aab97-99945f649-7bmqx

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-287e139e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-287e139e

openshift-ingress

deployment-controller

e2e-mt-287e139e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-287e139e-openshift-default-5549b99b84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-287e139e-openshift-default-5549b99b84

SuccessfulCreate

Created pod: e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

openshift-ingress

multus

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-287e139e-958d5ccbf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-287e139e-958d5ccbf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-287e139e-958d5ccbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-287e139e: serviceaccount "payload-processing-e2e-mt-287e139e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-287e139e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-287e139e-58f79d8b78 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-287e139e-58f79d8b78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-287e139e-58f79d8b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-287e139e: serviceaccount "payload-processing-e2e-mt-287e139e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-287e139e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-287e139e-958d5ccbf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-287e139e-58f79d8b78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-287e139e-58f79d8b78-sz9g5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-287e139e-958d5ccbf-d98c9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-287e139e-openshift-default-5549b99b84-vlhvt

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-38e192-openshift-default-656755d6f4

SuccessfulCreate

Created pod: e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

openshift-ingress

deployment-controller

e2e-shared-a-w2-38e192-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-38e192-openshift-default-656755d6f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-38e192

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-38e192

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-38e192

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-38e192-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-38e192-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-38e192

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-38e192-6467d6676f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-38e192-6467d6676f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-38e192: serviceaccount "payload-processing-e2e-shared-a-w2-38e192" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-38e192-6467d6676f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-38e192: serviceaccount "payload-processing-e2e-shared-a-w2-38e192" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-38e192

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-38e192-6467d6676f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7aab97-5496776878-pz99p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7aab97-99945f649-7bmqx

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-7ff93e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-7ff93e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-7ff93e

openshift-ingress

replicaset-controller

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656

SuccessfulCreate

Created pod: e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-7ff93e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7ff93e: serviceaccount "payload-processing-e2e-shared-b-w2-7ff93e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-7ff93e: serviceaccount "payload-processing-e2e-shared-b-w2-7ff93e" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-7ff93e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-7aab97-openshift-default-7f96b887cb-j7zxn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-06e7b2-openshift-default-5498d986d8

SuccessfulCreate

Created pod: e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

openshift-ingress

deployment-controller

e2e-noten-06e7b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-06e7b2-openshift-default-5498d986d8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-06e7b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-06e7b2

openshift-ingress

multus

e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-000f34a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-000f34a9

openshift-ingress

deployment-controller

e2e-mt-000f34a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-000f34a9-openshift-default-578664bb88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-000f34a9-openshift-default-578664bb88

SuccessfulCreate

Created pod: e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

openshift-ingress

multus

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-000f34a9-686c44d485

FailedCreate

Error creating: pods "payload-processing-e2e-mt-000f34a9-686c44d485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-000f34a9: serviceaccount "payload-processing-e2e-mt-000f34a9" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-000f34a9: serviceaccount "payload-processing-e2e-mt-000f34a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-000f34a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-000f34a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-000f34a9-686c44d485 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-000f34a9-686c44d485

SuccessfulCreate

Created pod: payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a36bf3-86d9747967-98rkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a36bf3-796d9fcd74-kzsqb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-a36bf3-openshift-default-6fd54959fb-qchtq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-321811-6bd5b9789d-r2r5z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-321811-c87f9db8c-8hx2b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-321811-openshift-default-7bfdf4974d-pz62m

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-5d3ac7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-5d3ac7-openshift-default-69548df498 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-5d3ac7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-5d3ac7

openshift-ingress

replicaset-controller

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498

SuccessfulCreate

Created pod: e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

openshift-ingress

kubelet

e2e-noten-06e7b2-openshift-default-5498d986d8-hdftb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-5d3ac7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-5d3ac7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5d3ac7: serviceaccount "payload-processing-e2e-shared-a-w3-5d3ac7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-5d3ac7: serviceaccount "payload-processing-e2e-shared-a-w3-5d3ac7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4

SuccessfulCreate

Created pod: e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

openshift-ingress

deployment-controller

e2e-shared-b-w3-86995c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-86995c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-86995c

openshift-ingress

multus

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-86995c: serviceaccount "payload-processing-e2e-shared-b-w3-86995c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-86995c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-86995c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-86995c: serviceaccount "payload-processing-e2e-shared-b-w3-86995c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

ProbeError

Readiness probe error: Get "http://10.134.0.80:15021/healthz/ready": read tcp 10.134.0.2:56780->10.134.0.80:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Unhealthy

Readiness probe failed: Get "http://10.134.0.80:15021/healthz/ready": read tcp 10.134.0.2:56780->10.134.0.80:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-000f34a9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-000f34a9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-000f34a9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-000f34a9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2176b93d-0579-4c9e-8df1-9c55acb18379, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-000f34a9-5c9658cbf4-qt87k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-000f34a9-686c44d485-s2svn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-000f34a9-openshift-default-578664bb88-chl5t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-api-a-b32209-openshift-default-66b75d7fd8

SuccessfulCreate

Created pod: e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

openshift-ingress

deployment-controller

e2e-api-a-b32209-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b32209-openshift-default-66b75d7fd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b32209

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b32209

openshift-ingress

multus

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b32209

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b32209-7cd697c659 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b32209-7cd697c659

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

openshift-ingress

multus

payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b32209

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b32209-ff6c8d958 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b32209-ff6c8d958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b32209-ff6c8d958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b32209-ff6c8d958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b32209: serviceaccount "payload-processing-e2e-api-a-b32209" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b32209-7cd697c659

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b32209-7cd697c659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b32209: serviceaccount "payload-processing-e2e-api-a-b32209" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-318a3c-openshift-default-57cdd5c488

SuccessfulCreate

Created pod: e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

openshift-ingress

deployment-controller

e2e-api-b-318a3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-318a3c-openshift-default-57cdd5c488 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-318a3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-318a3c
(x5)

openshift-ingress

kubelet

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-318a3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-318a3c-6cc85d96bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-318a3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-318a3c-54686f84db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-318a3c-54686f84db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-318a3c-54686f84db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-318a3c-54686f84db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-318a3c: serviceaccount "payload-processing-e2e-api-b-318a3c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-318a3c-6cc85d96bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-318a3c-6cc85d96bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-318a3c-6cc85d96bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-318a3c: serviceaccount "payload-processing-e2e-api-b-318a3c" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-b32209-7cd697c659-p2sqd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b32209-ff6c8d958-69l8t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-b32209-openshift-default-66b75d7fd8-mz8c8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-99c616-c4bd86ff8-jk46v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-99c616-d9d7d7747-zwxsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-318a3c-6cc85d96bc-kskn7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-318a3c-54686f84db-xwcjh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-99c616-openshift-default-54d44b8c68-57zj4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-318a3c-openshift-default-57cdd5c488-6nzg2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-38e192-76554f8c54-gsjhw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-38e192-6467d6676f-jb9gs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-38e192-openshift-default-656755d6f4-ffzjx

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-7ff93e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7ff93e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-7ff93e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-7ff93e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b31a2cad-6d4e-4859-b8e4-51d2514f8a93, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-7ff93e-574dff7ffd-qdvl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-7ff93e-656467bb9f-d7wfj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-7ff93e-openshift-default-7dd6bc6656-k8ns4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-8e5935-77769c84f8-t484b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-8e5935-d88d756f-4sccg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-8e5935-openshift-default-5dc7bb4f58-bvx85

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-39c298

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-39c298

openshift-ingress

deployment-controller

e2e-ipp-a-39c298-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-39c298-openshift-default-6b65d754f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-39c298-openshift-default-6b65d754f8

SuccessfulCreate

Created pod: e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

openshift-ingress

multus

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-39c298

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-39c298-b7b7897bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-39c298-844858875d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-39c298-b7b7897bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-39c298-b7b7897bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-39c298: serviceaccount "payload-processing-e2e-ipp-a-39c298" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-39c298

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-39c298-844858875d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-39c298-844858875d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-39c298-844858875d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-39c298: serviceaccount "payload-processing-e2e-ipp-a-39c298" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-39c298-b7b7897bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

openshift-ingress

multus

payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

AddedInterface

Add eth0 [10.134.0.99/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-8020f1-openshift-default-588fbf84f4

SuccessfulCreate

Created pod: e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

openshift-ingress

deployment-controller

e2e-ipp-b-8020f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8020f1-openshift-default-588fbf84f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8020f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8020f1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8020f1-84b75ddc97

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8020f1-84b75ddc97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8020f1: serviceaccount "payload-processing-e2e-ipp-b-8020f1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8020f1: serviceaccount "payload-processing-e2e-ipp-b-8020f1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8020f1-84b75ddc97

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8020f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

AddedInterface

Add eth0 [10.134.0.100/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8020f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8020f1-84b75ddc97 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

ProbeError

Readiness probe error: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Unhealthy

Readiness probe failed: Get "http://10.134.0.99:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

ProbeError

Startup probe error: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Unhealthy

Startup probe failed: Get "http://10.134.0.99:15021/healthz/ready": dial tcp 10.134.0.99:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

openshift-ingress

multus

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

AddedInterface

Add eth0 [10.134.0.102/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-072cc4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-072cc4

openshift-ingress

deployment-controller

e2e-ipp-cleanup-072cc4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-072cc4: serviceaccount "payload-processing-e2e-ipp-cleanup-072cc4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-072cc4: serviceaccount "payload-processing-e2e-ipp-cleanup-072cc4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-072cc4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-072cc4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

ProbeError

Startup probe error: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

Unhealthy

Startup probe failed: Get "http://10.134.0.102:15021/healthz/ready": dial tcp 10.134.0.102:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-072cc4-6c86694d58-7965j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-072cc4-5ff548fd45-cp575

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-072cc4-openshift-default-55fdf978f8-cjl84

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-39c298-b7b7897bf-5x8tp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-39c298-844858875d-c6crf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-39c298-openshift-default-6b65d754f8-6m58x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8020f1-64c94dd578-9c8x9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8020f1-84b75ddc97-bv8bj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-8020f1-openshift-default-588fbf84f4-5b98b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-5d3ac7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5d3ac7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-5d3ac7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-5d3ac7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0f3d525e-9f8b-40f7-84b7-32168c5ba7f2, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-5d3ac7-f44c99d8b-64j4m

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-5d3ac7-8698987bdf-25lt7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-5d3ac7-openshift-default-69548df498-xm9h2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-86995c-5744967cf8-9jc6s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-86995c-bbf4dd68f-8xdrl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-86995c-openshift-default-7bbc857fc4-fmnhs

Killing

Stopping container istio-proxy