Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f76076-7bf454798f-59j74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f76076-7bf454798f-59j74 to ip-10-0-138-82.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2 to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

Scheduled

Successfully assigned openshift-ingress/e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5 to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-6008a04d-68687774df-nvd4n to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66 to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2 to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr to ip-10-0-139-38.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4 to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4 to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5 to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95 to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6 to ip-10-0-136-27.ec2.internal

openshift-ingress

kube-auth-proxy-5d55d58b74-z2fdn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d55d58b74-z2fdn to ip-10-0-139-38.ec2.internal

openshift-ingress

kube-auth-proxy-5d55d58b74-dpn26

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d55d58b74-dpn26 to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7 to ip-10-0-139-38.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-t8dtn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dtn to ip-10-0-139-38.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-lxt9k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-lxt9k to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4 to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-04331c-f7d479cf-42r64 to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l to ip-10-0-136-27.ec2.internal

openshift-ingress

router-default-57b5479c4b-82pb9

Scheduled

Successfully assigned openshift-ingress/router-default-57b5479c4b-82pb9 to ip-10-0-139-38.ec2.internal

openshift-ingress

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4 to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-z2ht6

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-z2ht6 to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-c6zmp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-c6zmp to ip-10-0-139-38.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52 to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Scheduled

Successfully assigned openshift-ingress/e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5 to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z to ip-10-0-139-38.ec2.internal

openshift-ingress

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn to ip-10-0-136-27.ec2.internal

openshift-ingress

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4 to ip-10-0-138-82.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8 to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb to ip-10-0-138-82.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fvg7z to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf to ip-10-0-138-82.ec2.internal

openshift-ingress

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Scheduled

Successfully assigned openshift-ingress/e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc to ip-10-0-136-27.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n to ip-10-0-138-82.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-57b5479c4b from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-57b5479c4b

FailedCreate

Error creating: pods "router-default-57b5479c4b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-57b5479c4b

FailedCreate

Error creating: pods "router-default-57b5479c4b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-57b5479c4b

SuccessfulCreate

Created pod: router-default-57b5479c4b-82pb9
(x5)

openshift-ingress

kubelet

router-default-57b5479c4b-82pb9

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-57b5479c4b-82pb9

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-57b5479c4b-82pb9

Created

Created container: router

openshift-ingress

kubelet

router-default-57b5479c4b-82pb9

Started

Started container router

openshift-ingress

multus

router-default-57b5479c4b-82pb9

AddedInterface

Add eth0 [10.133.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-57b5479c4b-82pb9

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-5d55d58b74

FailedCreate

Error creating: pods "kube-auth-proxy-5d55d58b74-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5d55d58b74 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5d55d58b74

SuccessfulCreate

Created pod: kube-auth-proxy-5d55d58b74-z2fdn

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-dpn26

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-z2fdn

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5d55d58b74

SuccessfulCreate

Created pod: kube-auth-proxy-5d55d58b74-dpn26

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-t8dtn

openshift-ingress

multus

kube-auth-proxy-5d55d58b74-dpn26

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5d55d58b74-z2fdn

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-z2fdn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-dpn26

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-t8dtn

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-dpn26

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.668s (2.668s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-dpn26

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-z2fdn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-z2fdn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-z2fdn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.697s (2.697s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d55d58b74-dpn26

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 9.03s (9.03s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.856s (2.856s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-thfd2

Started

Started container istio-proxy

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-lxt9k

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lxt9k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-lxt9k

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lxt9k

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lxt9k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.571s (2.571s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lxt9k

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lxt9k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lxt9k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-t8dtn

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dtn

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-fvg7z

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-z2ht6

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-c6zmp

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2ht6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-c6zmp

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-z2ht6

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-c6zmp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2ht6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2ht6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-z2ht6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.427s (1.427s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-c6zmp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.856s (1.856s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-c6zmp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-c6zmp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

Unhealthy

Readiness probe failed: Get "http://10.134.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

ProbeError

Readiness probe error: Get "http://10.134.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-fvg7z

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a58a49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a58a49

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4b032e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4b032e

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-a8ee95

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-a8ee95

openshift-ingress

replicaset-controller

e2e-inf-a-a58a49-openshift-default-6d88887494

SuccessfulCreate

Created pod: e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

openshift-ingress

replicaset-controller

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8

SuccessfulCreate

Created pod: e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

openshift-ingress

deployment-controller

e2e-worker-w4-a8ee95-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-a8ee95-openshift-default-79bcb67594 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-a8ee95-openshift-default-79bcb67594

SuccessfulCreate

Created pod: e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

openshift-ingress

multus

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

e2e-inf-a-a58a49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a58a49-openshift-default-6d88887494 from 0 to 1

openshift-ingress

deployment-controller

e2e-worker-w0-4b032e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4b032e-openshift-default-76dfb67dd8 from 0 to 1

openshift-ingress

multus

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.802s (2.802s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a8ee95: serviceaccount "payload-processing-e2e-worker-w4-a8ee95" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-a8ee95

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a8ee95-58774d757c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-a8ee95-58774d757c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-a8ee95: serviceaccount "payload-processing-e2e-worker-w4-a8ee95" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-a8ee95

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-a8ee95-58774d757c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-a8ee95-58774d757c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a58a49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a58a49-6875899b9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a58a49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a58a49-6875899b9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a58a49-6875899b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a58a49: serviceaccount "payload-processing-e2e-inf-a-a58a49" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a58a49: serviceaccount "payload-processing-e2e-inf-a-a58a49" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a58a49-6875899b9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-7df2ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-7df2ac-openshift-default-5f97546b56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-7df2ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-7df2ac

openshift-ingress

replicaset-controller

e2e-autores-7df2ac-openshift-default-5f97546b56

SuccessfulCreate

Created pod: e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

openshift-ingress

multus

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4b032e: serviceaccount "payload-processing-e2e-worker-w0-4b032e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4b032e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4b032e-76485b7f59

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4b032e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4b032e-76485b7f59 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4b032e-76485b7f59

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4b032e-76485b7f59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4b032e: serviceaccount "payload-processing-e2e-worker-w0-4b032e" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

e2e-ait-6fddae31-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6fddae31-openshift-default-c8cfdbc8d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-6fddae31-openshift-default-c8cfdbc8d

SuccessfulCreate

Created pod: e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

openshift-ingress

gateway_labeler_controller

e2e-ait-6fddae31

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6fddae31

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.271s (3.271s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.003s (2.003s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-04331c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-04331c-openshift-default-77d86bcd5b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-04331c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-04331c

openshift-ingress

deployment-controller

payload-processing-e2e-autores-7df2ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-7df2ac-56956d7f67 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-7df2ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-04331c-openshift-default-77d86bcd5b

SuccessfulCreate

Created pod: e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

openshift-ingress

kubelet

payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7df2ac: serviceaccount "payload-processing-e2e-autores-7df2ac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

openshift-ingress

multus

payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7df2ac-56956d7f67

SuccessfulCreate

Created pod: payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7df2ac-56956d7f67

FailedCreate

Error creating: pods "payload-processing-e2e-autores-7df2ac-56956d7f67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7df2ac: serviceaccount "payload-processing-e2e-autores-7df2ac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6fddae31-c758fb8c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6fddae31-c758fb8c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6fddae31: serviceaccount "payload-processing-e2e-ait-6fddae31" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6fddae31

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6fddae31-57c65545c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6fddae31-57c65545c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6fddae31-57c65545c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6fddae31: serviceaccount "payload-processing-e2e-ait-6fddae31" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6fddae31

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6fddae31-c758fb8c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6fddae31-57c65545c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6fddae31-c758fb8c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-04331c-f7d479cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-04331c-f7d479cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-04331c: serviceaccount "payload-processing-e2e-inf-b-04331c" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-04331c-577fd75d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-04331c-577fd75d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-04331c: serviceaccount "payload-processing-e2e-inf-b-04331c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-04331c-f7d479cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-04331c-577fd75d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-04331c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-04331c-f7d479cf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-04331c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-04331c-577fd75d54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Unhealthy

Startup probe failed: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

ProbeError

Startup probe error: Get "http://10.132.0.33:15021/healthz/ready": dial tcp 10.132.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-6fddae31

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-6fddae31: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-6fddae31": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-6fddae31, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f31793d-e126-4b2c-b873-bf2a995cdd35, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6fddae31-57c65545c8-2cksj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ait-6fddae31-c758fb8c5-qw77g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-6fddae31-openshift-default-c8cfdbc8d-hx8pj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-c8fc710a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c8fc710a-gw

openshift-ingress

multus

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-c8fc710a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6

SuccessfulCreate

Created pod: e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c8fc710a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c8fc710a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c8fc710a-94fc65f58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c8fc710a-94fc65f58

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c8fc710a: serviceaccount "payload-processing-e2e-migrate-c8fc710a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c8fc710a-94fc65f58

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c8fc710a-94fc65f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c8fc710a: serviceaccount "payload-processing-e2e-migrate-c8fc710a" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c8fc710a-54c998cf78-r4wqw

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-c8fc710a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-c8fc710a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-c8fc710a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-c8fc710a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0c4ef45b-b2f5-44b3-8baa-724c8a63dc52, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c8fc710a-94fc65f58-zmnkh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-c8fc710a-gw-openshift-default-74b5d6b6f6-bblnw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-5d9a4dfe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5d9a4dfe

openshift-ingress

deployment-controller

e2e-ait-5d9a4dfe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4

SuccessfulCreate

Created pod: e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

openshift-ingress

multus

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5d9a4dfe-b8669597f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5d9a4dfe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5d9a4dfe-b8669597f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5d9a4dfe-b8669597f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5d9a4dfe-b8669597f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5d9a4dfe: serviceaccount "payload-processing-e2e-ait-5d9a4dfe" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5d9a4dfe: serviceaccount "payload-processing-e2e-ait-5d9a4dfe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5d9a4dfe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5d9a4dfe-56cb684d4b-tw8rd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5d9a4dfe-b8669597f-g2b2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-5d9a4dfe-openshift-default-7b54fdd7d4-kbv66

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-6008a04d-openshift-default-c697dfdbd

SuccessfulCreate

Created pod: e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

openshift-ingress

deployment-controller

e2e-derive-6008a04d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-6008a04d-openshift-default-c697dfdbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-6008a04d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-6008a04d

openshift-ingress

multus

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6008a04d-68687774df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-6008a04d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6008a04d: serviceaccount "payload-processing-e2e-derive-6008a04d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-6008a04d-68687774df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-6008a04d-68687774df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-6008a04d: serviceaccount "payload-processing-e2e-derive-6008a04d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-6008a04d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-6008a04d-68687774df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-6008a04d-7b6f6f8c54-8xdxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-6008a04d-68687774df-nvd4n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-6008a04d-openshift-default-c697dfdbd-zhrjc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7df2ac-7b5d5b6846-8bch4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-7df2ac-56956d7f67-pggrb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-autores-7df2ac-openshift-default-5f97546b56-4gkz5

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-explicit-f76076

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f76076

openshift-ingress

deployment-controller

e2e-explicit-f76076-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f76076-openshift-default-f7bb64d6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-f76076-openshift-default-f7bb64d6d

SuccessfulCreate

Created pod: e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f76076

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f76076-7bf454798f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f76076-766bcf977d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f76076

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f76076-766bcf977d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f76076-766bcf977d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f76076-766bcf977d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f76076: serviceaccount "payload-processing-e2e-explicit-f76076" not found

openshift-ingress

multus

payload-processing-e2e-explicit-f76076-7bf454798f-59j74

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-f76076-7bf454798f-59j74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-f76076-7bf454798f-59j74

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f76076-7bf454798f-59j74

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f76076-7bf454798f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f76076-7bf454798f-59j74
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f76076-7bf454798f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f76076-7bf454798f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f76076: serviceaccount "payload-processing-e2e-explicit-f76076" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-81969518-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-81969518-openshift-default-78bcbcc5bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-81969518

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-81969518

openshift-ingress

replicaset-controller

e2e-mt-81969518-openshift-default-78bcbcc5bd

SuccessfulCreate

Created pod: e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

openshift-ingress

multus

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-81969518

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-81969518-6949cd47c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-81969518-6949cd47c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-81969518-6949cd47c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-81969518-6949cd47c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-81969518: serviceaccount "payload-processing-e2e-mt-81969518" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-81969518-6c6bfd774f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-81969518-6c6bfd774f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-81969518: serviceaccount "payload-processing-e2e-mt-81969518" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-81969518-6c6bfd774f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

openshift-ingress

deployment-controller

payload-processing-e2e-mt-81969518

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-81969518-6c6bfd774f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81969518-6949cd47c4-d8pkc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-81969518-6c6bfd774f-j6prc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-81969518-openshift-default-78bcbcc5bd-d6mgz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-e8cfcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b

SuccessfulCreate

Created pod: e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-e8cfcf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-e8cfcf

openshift-ingress

multus

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-e8cfcf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-e8cfcf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e8cfcf: serviceaccount "payload-processing-e2e-shared-a-w2-e8cfcf" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-e8cfcf: serviceaccount "payload-processing-e2e-shared-a-w2-e8cfcf" not found

openshift-ingress

deployment-controller

e2e-shared-b-w2-f7fd24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f7fd24

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f7fd24

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b

SuccessfulCreate

Created pod: e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

openshift-ingress

multus

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f7fd24: serviceaccount "payload-processing-e2e-shared-b-w2-f7fd24" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f7fd24

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f7fd24: serviceaccount "payload-processing-e2e-shared-b-w2-f7fd24" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f7fd24

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f76076-766bcf977d-9xf6g

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-f76076

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-f76076: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-f76076": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-f76076, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3700cac4-1a43-4983-984e-e544757be9d3, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-f76076-7bf454798f-59j74

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-f76076-openshift-default-f7bb64d6d-kwwrh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-d46ae3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-d46ae3-openshift-default-5d8df4b5cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-d46ae3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-d46ae3

openshift-ingress

replicaset-controller

e2e-noten-d46ae3-openshift-default-5d8df4b5cd

SuccessfulCreate

Created pod: e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

openshift-ingress

kubelet

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-105b25aa-openshift-default-74fc4f5968

SuccessfulCreate

Created pod: e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

openshift-ingress

gateway_labeler_controller

e2e-mt-105b25aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-105b25aa

openshift-ingress

deployment-controller

e2e-mt-105b25aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-105b25aa-openshift-default-74fc4f5968 from 0 to 1

openshift-ingress

multus

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a58a49-7df5dbf958-94jdr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a58a49-6875899b9-vs6fx

Killing

Stopping container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-105b25aa: serviceaccount "payload-processing-e2e-mt-105b25aa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-105b25aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-105b25aa-76646cfc9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-105b25aa: serviceaccount "payload-processing-e2e-mt-105b25aa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

openshift-ingress

deployment-controller

payload-processing-e2e-mt-105b25aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-105b25aa-7d7cc5fbcc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a58a49-openshift-default-6d88887494-xn58t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-04331c-577fd75d54-hwss2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-04331c-f7d479cf-42r64

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-57d97d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-57d97d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-57d97d

openshift-ingress

replicaset-controller

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b

SuccessfulCreate

Created pod: e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

openshift-ingress

multus

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-04331c-openshift-default-77d86bcd5b-8fsn7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-57d97d: serviceaccount "payload-processing-e2e-shared-a-w3-57d97d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-57d97d: serviceaccount "payload-processing-e2e-shared-a-w3-57d97d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-57d97d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-57d97d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-8a4eb7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-8a4eb7

openshift-ingress

deployment-controller

e2e-shared-b-w3-8a4eb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb

SuccessfulCreate

Created pod: e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

openshift-ingress

multus

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8a4eb7: serviceaccount "payload-processing-e2e-shared-b-w3-8a4eb7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8a4eb7: serviceaccount "payload-processing-e2e-shared-b-w3-8a4eb7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-8a4eb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-8a4eb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-d46ae3-openshift-default-5d8df4b5cd-cltm5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-105b25aa-76646cfc9d-m6p4x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-105b25aa-7d7cc5fbcc-khmpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-105b25aa-openshift-default-74fc4f5968-kfblw

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-e7cdd6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e7cdd6-openshift-default-746dbfb5f8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8

SuccessfulCreate

Created pod: e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

openshift-ingress

gateway_labeler_controller

e2e-api-a-e7cdd6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e7cdd6

openshift-ingress

multus

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e7cdd6-88bc89bfc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e7cdd6-88bc89bfc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e7cdd6-88bc89bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e7cdd6: serviceaccount "payload-processing-e2e-api-a-e7cdd6" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e7cdd6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e7cdd6-88bc89bfc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e7cdd6: serviceaccount "payload-processing-e2e-api-a-e7cdd6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e7cdd6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-b1a074

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-b1a074

openshift-ingress

replicaset-controller

e2e-api-b-b1a074-openshift-default-74c5db6cfb

SuccessfulCreate

Created pod: e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

openshift-ingress

deployment-controller

e2e-api-b-b1a074-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-b1a074-openshift-default-74c5db6cfb from 0 to 1

openshift-ingress

multus

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4b032e-76485b7f59-5cr6r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4b032e-7794845bc4-tn7x8

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-b1a074

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-b1a074-684b9567c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b1a074-6bb9b75cc9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-b1a074-6bb9b75cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b1a074: serviceaccount "payload-processing-e2e-api-b-b1a074" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b1a074-684b9567c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-b1a074-684b9567c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-b1a074: serviceaccount "payload-processing-e2e-api-b-b1a074" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-b1a074

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-b1a074-6bb9b75cc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-b1a074-684b9567c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-b1a074-6bb9b75cc9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

openshift-ingress

kubelet

payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4b032e-openshift-default-76dfb67dd8-q5n7z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e7cdd6-7cdccf8786-jwmbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e7cdd6-88bc89bfc-r95tt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-e7cdd6-openshift-default-746dbfb5f8-lnrn6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-b1a074-684b9567c4-2xf8s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-b1a074-6bb9b75cc9-jbblw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-b1a074-openshift-default-74c5db6cfb-tmtqv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-a8ee95-6b84556ff4-gp78s

Unhealthy

Readiness probe failed: dial tcp 10.134.0.38:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-a8ee95

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-a8ee95: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-a8ee95": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-a8ee95, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 552ab5f9-7e62-42a7-b1ca-537ea56b8040, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-a8ee95-58774d757c-5b4rk

Unhealthy

Readiness probe failed: dial tcp 10.134.0.37:9004: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-e8cfcf-c557b9dcd-jxz8c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-e8cfcf-5c669f8cf5-khqdv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-a8ee95-openshift-default-79bcb67594-qw5h4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-e8cfcf-openshift-default-6bdc48cf5b-kj2nn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f7fd24-9dc848bb6-hknpp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f7fd24-7cf8bb44d5-ncz8n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-f7fd24-openshift-default-b7d7fcb6b-rcfv4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-96e341

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-96e341

openshift-ingress

deployment-controller

e2e-ipp-a-96e341-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-96e341-openshift-default-6b66cd7c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-96e341-openshift-default-6b66cd7c8

SuccessfulCreate

Created pod: e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

openshift-ingress

multus

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-96e341-758f497485

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-96e341-758f497485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-96e341: serviceaccount "payload-processing-e2e-ipp-a-96e341" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-96e341-5d678db778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-96e341-5d678db778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-96e341: serviceaccount "payload-processing-e2e-ipp-a-96e341" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-96e341-758f497485

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-96e341

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-96e341-758f497485 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-96e341

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-96e341-5d678db778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-96e341-5d678db778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-df1a8a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-df1a8a

openshift-ingress

replicaset-controller

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4

SuccessfulCreate

Created pod: e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

openshift-ingress

multus

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-df1a8a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df1a8a: serviceaccount "payload-processing-e2e-ipp-b-df1a8a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-df1a8a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-df1a8a: serviceaccount "payload-processing-e2e-ipp-b-df1a8a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-df1a8a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2f8fd9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2f8fd9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2f8fd9

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

openshift-ingress

multus

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2f8fd9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2f8fd9: serviceaccount "payload-processing-e2e-ipp-cleanup-2f8fd9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2f8fd9: serviceaccount "payload-processing-e2e-ipp-cleanup-2f8fd9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2f8fd9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2f8fd9-57b6bb46c7-4sc52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2f8fd9-56959f4dc4-9mp9z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2f8fd9-openshift-default-54c88f85db-mqckn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-96e341-5d678db778-xnp8g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-96e341-758f497485-qdvmt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-96e341-openshift-default-6b66cd7c8-99bs4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-df1a8a-7dd6c78b85-ldznt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-df1a8a-5c5d4545d6-c6fz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-df1a8a-openshift-default-5fc77cd8f4-bkjtn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-57d97d-67595d44c4-9wdp5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-57d97d-6f866b6fcf-fs8cf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-57d97d-openshift-default-6b85b8587b-5rg95

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

Unhealthy

Readiness probe failed: dial tcp 10.134.0.67:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8a4eb7-74fb5ff5cd-gl4tb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8a4eb7-66bf979995-x6s6l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-8a4eb7-openshift-default-7cf4584cb-pth8w

Killing

Stopping container istio-proxy