Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv to ip-10-0-132-187.ec2.internal

openshift-ingress

kube-auth-proxy-85cdd48bb5-v6c8k

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-85cdd48bb5-v6c8k to ip-10-0-132-187.ec2.internal

openshift-ingress

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp to ip-10-0-132-187.ec2.internal

openshift-ingress

kube-auth-proxy-85cdd48bb5-vg2xq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-85cdd48bb5-vg2xq to ip-10-0-130-92.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2 to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-8424a6-65555f889c-xn48f to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2 to ip-10-0-132-187.ec2.internal

openshift-ingress

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh to ip-10-0-132-187.ec2.internal

openshift-ingress

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl to ip-10-0-132-35.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-5vgzv

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-5vgzv to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5 to ip-10-0-132-187.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8 to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-9kv57

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-9kv57 to ip-10-0-130-92.ec2.internal

openshift-ingress

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2 to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44 to ip-10-0-130-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64 to ip-10-0-130-92.ec2.internal

openshift-ingress

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9 to ip-10-0-130-92.ec2.internal

openshift-ingress

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g to ip-10-0-132-35.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-j9d9x to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4 to ip-10-0-132-187.ec2.internal

openshift-ingress

router-default-5f75549b6d-nxsnx

Scheduled

Successfully assigned openshift-ingress/router-default-5f75549b6d-nxsnx to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7 to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Scheduled

Successfully assigned openshift-ingress/e2e-autores-21df59-openshift-default-7775879dcb-8q4vb to ip-10-0-132-187.ec2.internal

openshift-ingress

e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9 to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4 to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-nczzc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-nczzc to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9 to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-116f55-openshift-default-668f5789c8-frx55 to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879 to ip-10-0-130-92.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7 to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh to ip-10-0-132-35.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g to ip-10-0-132-187.ec2.internal

openshift-ingress

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n to ip-10-0-130-92.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc to ip-10-0-132-35.ec2.internal

openshift-ingress

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

Scheduled

Successfully assigned openshift-ingress/e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls to ip-10-0-132-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv to ip-10-0-132-35.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5 to ip-10-0-132-35.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-n8jcb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-n8jcb to ip-10-0-132-187.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5f75549b6d from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-5f75549b6d

FailedCreate

Error creating: pods "router-default-5f75549b6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5f75549b6d

FailedCreate

Error creating: pods "router-default-5f75549b6d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5f75549b6d

SuccessfulCreate

Created pod: router-default-5f75549b6d-nxsnx
(x5)

openshift-ingress

kubelet

router-default-5f75549b6d-nxsnx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5f75549b6d-nxsnx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5f75549b6d-nxsnx

AddedInterface

Add eth0 [10.133.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5f75549b6d-nxsnx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-5f75549b6d-nxsnx

Created

Created container: router

openshift-ingress

kubelet

router-default-5f75549b6d-nxsnx

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-85cdd48bb5

SuccessfulCreate

Created pod: kube-auth-proxy-85cdd48bb5-vg2xq

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-85cdd48bb5 from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-85cdd48bb5

FailedCreate

Error creating: pods "kube-auth-proxy-85cdd48bb5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-85cdd48bb5

SuccessfulCreate

Created pod: kube-auth-proxy-85cdd48bb5-v6c8k

openshift-ingress

multus

kube-auth-proxy-85cdd48bb5-vg2xq

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-vg2xq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-v6c8k

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-85cdd48bb5-v6c8k

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-n8jcb

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-vg2xq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-vg2xq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-vg2xq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.622s (2.622s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-n8jcb

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-v6c8k

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-v6c8k

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85cdd48bb5-v6c8k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.719s (2.719s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8jcb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8jcb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8jcb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.404s (2.404s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8jcb

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.349s (3.349s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qqc2g

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-5vgzv

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5vgzv

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-5vgzv

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5vgzv

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5vgzv

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5vgzv

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.185s (2.185s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5vgzv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-5vgzv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-n8jcb

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-n8jcb
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-j9d9x

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9kv57

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-9kv57

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-9kv57

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-nczzc

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-nczzc

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nczzc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9kv57

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nczzc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.643s (1.644s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nczzc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9kv57

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.804s (1.804s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-nczzc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9kv57

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-j9d9x

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-a-116f55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-116f55-openshift-default-668f5789c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd

SuccessfulCreate

Created pod: e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

openshift-ingress

replicaset-controller

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd

SuccessfulCreate

Created pod: e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

openshift-ingress

deployment-controller

e2e-worker-w0-a7d035-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-a7d035

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-a7d035

openshift-ingress

multus

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-6ad49b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-6ad49b

openshift-ingress

replicaset-controller

e2e-inf-a-116f55-openshift-default-668f5789c8

SuccessfulCreate

Created pod: e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

openshift-ingress

gateway_labeler_controller

e2e-inf-a-116f55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-116f55

openshift-ingress

deployment-controller

e2e-worker-w4-6ad49b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd from 0 to 1

openshift-ingress

multus

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.969s (2.969s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-116f55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-116f55-67564bbd74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-116f55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-116f55-8465c5f565 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-116f55-67564bbd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-116f55-67564bbd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-116f55: serviceaccount "payload-processing-e2e-inf-a-116f55" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-116f55-8465c5f565

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-116f55-8465c5f565

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-116f55-8465c5f565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-116f55: serviceaccount "payload-processing-e2e-inf-a-116f55" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-116f55-67564bbd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

openshift-ingress

gateway_labeler_controller

e2e-autores-21df59

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-21df59

openshift-ingress

replicaset-controller

e2e-autores-21df59-openshift-default-7775879dcb

SuccessfulCreate

Created pod: e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

openshift-ingress

multus

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-21df59-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-21df59-openshift-default-7775879dcb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-6ad49b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-6ad49b-749f759f8c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-6ad49b: serviceaccount "payload-processing-e2e-worker-w4-6ad49b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-6ad49b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-6ad49b-787575d898 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-6ad49b-749f759f8c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-6ad49b-749f759f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-6ad49b: serviceaccount "payload-processing-e2e-worker-w4-6ad49b" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.891s (1.891s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.407s (2.407s including waiting). Image size: 166453408 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-6ad49b-749f759f8c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a7d035-855bcb6d87

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a7d035: serviceaccount "payload-processing-e2e-worker-w0-a7d035" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-a7d035

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-a7d035-855bcb6d87 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-a7d035

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-a7d035-855bcb6d87

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-a7d035-855bcb6d87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-a7d035: serviceaccount "payload-processing-e2e-worker-w0-a7d035" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d

SuccessfulCreate

Created pod: e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

openshift-ingress

gateway_labeler_controller

e2e-ait-ef01a1fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ef01a1fd

openshift-ingress

deployment-controller

e2e-ait-ef01a1fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ef01a1fd-openshift-default-fc5d6d48d from 0 to 1

openshift-ingress

multus

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-21df59

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-21df59-5cc7956cbb from 0 to 1

openshift-ingress

kubelet

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-autores-21df59

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-21df59-68f85dd7f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-21df59-5cc7956cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-21df59-5cc7956cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-21df59-5cc7956cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-21df59: serviceaccount "payload-processing-e2e-autores-21df59" not found

openshift-ingress

gateway_labeler_controller

e2e-inf-b-1f86a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-1f86a8
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-21df59-68f85dd7f9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-21df59-68f85dd7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-21df59: serviceaccount "payload-processing-e2e-autores-21df59" not found

openshift-ingress

deployment-controller

e2e-inf-b-1f86a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d

SuccessfulCreate

Created pod: e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-21df59-68f85dd7f9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

openshift-ingress

multus

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ef01a1fd: serviceaccount "payload-processing-e2e-ait-ef01a1fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ef01a1fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ef01a1fd: serviceaccount "payload-processing-e2e-ait-ef01a1fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ef01a1fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ef01a1fd-6d7bd565c5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-1f86a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-1f86a8-6ff5844cff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1f86a8-6ff5844cff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1f86a8-6ff5844cff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-1f86a8-6ff5844cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1f86a8: serviceaccount "payload-processing-e2e-inf-b-1f86a8" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1f86a8: serviceaccount "payload-processing-e2e-inf-b-1f86a8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-1f86a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-ef01a1fd-6d7bd565c5-tgzhv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ef01a1fd-54fd95cb54-hfrxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ef01a1fd-openshift-default-fc5d6d48d-cw9l5

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876

SuccessfulCreate

Created pod: e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

openshift-ingress

gateway_labeler_controller

e2e-migrate-7e01a72f-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7e01a72f-gw

openshift-ingress

deployment-controller

e2e-migrate-7e01a72f-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7e01a72f-gw-openshift-default-67c6864876 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Started

Started container istio-proxy
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7e01a72f-56895c7766

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7e01a72f-56895c7766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7e01a72f: serviceaccount "payload-processing-e2e-migrate-7e01a72f" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7e01a72f: serviceaccount "payload-processing-e2e-migrate-7e01a72f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7e01a72f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7e01a72f-56895c7766 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7e01a72f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7e01a72f-56895c7766

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-7e01a72f-gw-openshift-default-67c6864876-ffgbp

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-7e01a72f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-7e01a72f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-7e01a72f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0dcf45ea-456e-406a-8251-4225bfb611cb, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e01a72f-56895c7766-fp9mk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e01a72f-7cf578dc46-5j6nz

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-1084f187-openshift-default-5d59cc64bb

SuccessfulCreate

Created pod: e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

openshift-ingress

deployment-controller

e2e-ait-1084f187-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1084f187-openshift-default-5d59cc64bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-1084f187

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1084f187

openshift-ingress

multus

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1084f187-7c56b5bd69

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1084f187-7c56b5bd69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1084f187: serviceaccount "payload-processing-e2e-ait-1084f187" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1084f187: serviceaccount "payload-processing-e2e-ait-1084f187" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1084f187-7c56b5bd69

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1084f187

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1084f187-77b85fd7bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1084f187

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1084f187-7c56b5bd69 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1084f187-7c56b5bd69-gx9w9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1084f187-77b85fd7bb-zbll5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-1084f187-openshift-default-5d59cc64bb-2wbfg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-derive-962c4157-openshift-default-6fc75d666d

SuccessfulCreate

Created pod: e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

openshift-ingress

gateway_labeler_controller

e2e-derive-962c4157

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-962c4157

openshift-ingress

deployment-controller

e2e-derive-962c4157-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-962c4157-openshift-default-6fc75d666d from 0 to 1

openshift-ingress

multus

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-962c4157-8c4bbdbd9

SuccessfulCreate

Created pod: payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-962c4157-8c4bbdbd9

FailedCreate

Error creating: pods "payload-processing-e2e-derive-962c4157-8c4bbdbd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-962c4157: serviceaccount "payload-processing-e2e-derive-962c4157" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-962c4157

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-962c4157-8c4bbdbd9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-962c4157

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-962c4157-bf9b4cddb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-962c4157: serviceaccount "payload-processing-e2e-derive-962c4157" not found

openshift-ingress

multus

payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-21df59-5cc7956cbb-vv879

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-21df59-68f85dd7f9-4cr9n

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-962c4157-bf9b4cddb-4pz7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-962c4157-8c4bbdbd9-x4qxl

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-962c4157-openshift-default-dockercfg-9flxb); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-962c4157-openshift-default-6fc75d666d-bc6ls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-21df59-openshift-default-7775879dcb-8q4vb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-773e07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-773e07

openshift-ingress

deployment-controller

e2e-explicit-773e07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-773e07-openshift-default-7456b59cd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-773e07-openshift-default-7456b59cd4

SuccessfulCreate

Created pod: e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-a7d035-855bcb6d87-t2mwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-a7d035-6f86b6d7c4-t9bxv

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-a7d035

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-a7d035": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-a7d035, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d1bfd75c-d1f4-4bc0-b487-3e6bbcfa8b4a, UID in object meta:

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-773e07-56b66cd48f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-773e07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-773e07-56b66cd48f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-773e07-fb6df6958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-773e07-fb6df6958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-773e07-fb6df6958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-773e07: serviceaccount "payload-processing-e2e-explicit-773e07" not found

openshift-ingress

multus

payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-773e07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-773e07-fb6df6958 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-773e07-56b66cd48f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-773e07-56b66cd48f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-773e07: serviceaccount "payload-processing-e2e-explicit-773e07" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-a7d035-openshift-default-5c5ddd5fbd-f9r44

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-a2b92ced-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a2b92ced-openshift-default-5cc7d5d884 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-a2b92ced

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a2b92ced

openshift-ingress

replicaset-controller

e2e-mt-a2b92ced-openshift-default-5cc7d5d884

SuccessfulCreate

Created pod: e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

openshift-ingress

multus

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a2b92ced

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a2b92ced-779ccf4969 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a2b92ced

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a2b92ced-795cd6789d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a2b92ced: serviceaccount "payload-processing-e2e-mt-a2b92ced" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a2b92ced-779ccf4969

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a2b92ced-779ccf4969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a2b92ced: serviceaccount "payload-processing-e2e-mt-a2b92ced" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a2b92ced-779ccf4969

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-773e07-fb6df6958-8dwq4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-773e07-56b66cd48f-r5bhc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a2b92ced-779ccf4969-kffx2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-a2b92ced

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-a2b92ced": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-a2b92ced, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6db3f558-2cc4-43ea-bc96-1a3671e3ed12, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a2b92ced-795cd6789d-zlhmh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a2b92ced-openshift-default-5cc7d5d884-pwgxn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894

SuccessfulCreate

Created pod: e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

openshift-ingress

deployment-controller

e2e-shared-a-w2-1b65ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-1b65ac-openshift-default-78cf99894 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-1b65ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-1b65ac

openshift-ingress

multus

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-1b65ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac: serviceaccount "payload-processing-e2e-shared-a-w2-1b65ac" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1b65ac: serviceaccount "payload-processing-e2e-shared-a-w2-1b65ac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-1b65ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-773e07-openshift-default-7456b59cd4-q4sm9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-f5a86c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f5a86c-openshift-default-76d8b9d586 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-f5a86c-openshift-default-76d8b9d586

SuccessfulCreate

Created pod: e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

openshift-ingress

gateway_labeler_controller

e2e-noten-f5a86c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f5a86c

openshift-ingress

GatewayAuthBootstrap

e2e-noten-f5a86c

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-f5a86c-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-f5a86c-authn-ssl" already exists

openshift-ingress

kubelet

e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-514a1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-514a1a

openshift-ingress

deployment-controller

e2e-shared-b-w2-514a1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d

SuccessfulCreate

Created pod: e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

openshift-ingress

multus

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-514a1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-514a1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a: serviceaccount "payload-processing-e2e-shared-b-w2-514a1a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-514a1a: serviceaccount "payload-processing-e2e-shared-b-w2-514a1a" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-f5a86c-openshift-default-76d8b9d586-6cjj9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-116f55-8465c5f565-l94sr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-116f55-67564bbd74-k9cfw

Killing

Stopping container payload-pre-processing
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-67ccba3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-67ccba3b

openshift-ingress

deployment-controller

e2e-mt-67ccba3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-67ccba3b-openshift-default-c96c5cb88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-67ccba3b-openshift-default-c96c5cb88

SuccessfulCreate

Created pod: e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-116f55-openshift-default-668f5789c8-frx55

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-67ccba3b-554f8fd66f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

openshift-ingress

deployment-controller

payload-processing-e2e-mt-67ccba3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-67ccba3b-554f8fd66f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-67ccba3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-67ccba3b: serviceaccount "payload-processing-e2e-mt-67ccba3b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-67ccba3b-554f8fd66f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-67ccba3b-554f8fd66f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-67ccba3b: serviceaccount "payload-processing-e2e-mt-67ccba3b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f86a8-6ff5844cff-qxqmv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f86a8-855874f7f4-f7nfk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-1f86a8-openshift-default-6c4f6bf54d-r9jp4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-cad5cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-cad5cf

openshift-ingress

deployment-controller

e2e-shared-a-w3-cad5cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88

SuccessfulCreate

Created pod: e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t
(x2)

openshift-ingress

kubelet

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

Created

Created container: istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf: serviceaccount "payload-processing-e2e-shared-a-w3-cad5cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-cad5cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-cad5cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cad5cf: serviceaccount "payload-processing-e2e-shared-a-w3-cad5cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-fd993e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-fd993e

openshift-ingress

deployment-controller

e2e-shared-b-w3-fd993e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78

SuccessfulCreate

Created pod: e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

ProbeError

Startup probe error: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Unhealthy

Startup probe failed: Get "http://10.134.0.76:15021/healthz/ready": dial tcp 10.134.0.76:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-fd993e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-fd993e-78f577dc97 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e: serviceaccount "payload-processing-e2e-shared-b-w3-fd993e" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-fd993e: serviceaccount "payload-processing-e2e-shared-b-w3-fd993e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-fd993e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-67ccba3b-6ff984f7c8-mqxc7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-67ccba3b-554f8fd66f-8lnkz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-67ccba3b-openshift-default-c96c5cb88-gvz7t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-6ad49b-787575d898-8ft8g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-6ad49b-749f759f8c-d29d7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-6ad49b-openshift-default-7d7bb455dd-vxzd2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-8424a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-8424a6-openshift-default-77cd9699cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-8424a6-openshift-default-77cd9699cd

SuccessfulCreate

Created pod: e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

openshift-ingress

gateway_labeler_controller

e2e-api-a-8424a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-8424a6

openshift-ingress

multus

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-8424a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-8424a6-65555f889c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-8424a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-8424a6-746c749f9d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8424a6-65555f889c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8424a6-746c749f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-8424a6-746c749f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-8424a6-746c749f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8424a6: serviceaccount "payload-processing-e2e-api-a-8424a6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-8424a6-65555f889c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-8424a6-65555f889c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-8424a6: serviceaccount "payload-processing-e2e-api-a-8424a6" not found
(x2)

openshift-ingress

kubelet

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-9e75fb-openshift-default-d9476d49d

SuccessfulCreate

Created pod: e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

openshift-ingress

gateway_labeler_controller

e2e-api-b-9e75fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9e75fb

openshift-ingress

deployment-controller

e2e-api-b-9e75fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9e75fb-openshift-default-d9476d49d from 0 to 1

openshift-ingress

multus

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9e75fb: serviceaccount "payload-processing-e2e-api-b-9e75fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9e75fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9e75fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9e75fb-dd6bbb9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9e75fb-dd6bbb9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9e75fb-dd6bbb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9e75fb: serviceaccount "payload-processing-e2e-api-b-9e75fb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9e75fb-dd6bbb9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

Unhealthy

Startup probe failed: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

ProbeError

Startup probe error: Get "http://10.134.0.87:15021/healthz/ready": dial tcp 10.134.0.87:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-8424a6-746c749f9d-szhc2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-8424a6-65555f889c-xn48f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-8424a6-openshift-default-77cd9699cd-cg9qp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9e75fb-5cb8bb8898-5pcmv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9e75fb-dd6bbb9-qvhjw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-9e75fb-openshift-default-d9476d49d-4k4mk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1b65ac-6d6dbdcc49-5ndbx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1b65ac-67648794f8-zzn6p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-1b65ac-openshift-default-78cf99894-h4dlh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-514a1a-7cbf5c7c78-kg75n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-514a1a-5f59c85f6f-sdhfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-514a1a-openshift-default-76bd5c667d-xz26n

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-5888e6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-5888e6

openshift-ingress

replicaset-controller

e2e-ipp-a-5888e6-openshift-default-6747cfdd94

SuccessfulCreate

Created pod: e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

openshift-ingress

deployment-controller

e2e-ipp-a-5888e6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-5888e6-openshift-default-6747cfdd94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5888e6: serviceaccount "payload-processing-e2e-ipp-a-5888e6" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-5888e6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-5888e6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-5888e6: serviceaccount "payload-processing-e2e-ipp-a-5888e6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Unhealthy

Readiness probe failed: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

ProbeError

Readiness probe error: Get "http://10.134.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

ProbeError

Startup probe error: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Unhealthy

Startup probe failed: Get "http://10.134.0.93:15021/healthz/ready": dial tcp 10.134.0.93:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-deac7a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-deac7a

openshift-ingress

deployment-controller

e2e-ipp-b-deac7a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-deac7a-openshift-default-54c8b9f594 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-deac7a-openshift-default-54c8b9f594

SuccessfulCreate

Created pod: e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

openshift-ingress

multus

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-deac7a-65ccd955f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-deac7a-65ccd955f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-deac7a: serviceaccount "payload-processing-e2e-ipp-b-deac7a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-deac7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-deac7a-65ccd955f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-deac7a: serviceaccount "payload-processing-e2e-ipp-b-deac7a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-deac7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-deac7a-65ccd955f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

Unhealthy

Startup probe failed: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

ProbeError

Startup probe error: Get "http://10.134.0.94:15021/healthz/ready": dial tcp 10.134.0.94:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b3d150

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b3d150

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b3d150-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

openshift-ingress

multus

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150: serviceaccount "payload-processing-e2e-ipp-cleanup-b3d150" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b3d150-66878df965

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b3d150-66878df965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b3d150: serviceaccount "payload-processing-e2e-ipp-cleanup-b3d150" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b3d150-66878df965

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b3d150

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b3d150-66878df965 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b3d150

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

ProbeError

Startup probe error: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

Unhealthy

Startup probe failed: Get "http://10.134.0.96:15021/healthz/ready": dial tcp 10.134.0.96:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b3d150-84d797d7d-lvt64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b3d150-66878df965-qfsnl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b3d150-openshift-default-68cdd48598-gmwk8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-5888e6-7fc6ff49b6-fmzjc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-5888e6-7f5f4c88fc-stlbf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-5888e6-openshift-default-6747cfdd94-cn7mz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-deac7a-65ccd955f7-jk9pd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-deac7a-55b5cc9b7d-gl95j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-deac7a-openshift-default-54c8b9f594-hxz9z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cad5cf-6f7ddff975-lz9hj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cad5cf-5897445454-wl7dq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-cad5cf-openshift-default-54c5d75b88-wm55t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fd993e-57b57f8574-46sds

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fd993e-78f577dc97-f2cjh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-fd993e-openshift-default-6c44fd6d78-4w8bl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503