Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6 to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2 to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7 to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-5e86f370-openshift-default-567877f884-q4xd8 to ip-10-0-138-45.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-nrvfw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-nrvfw to ip-10-0-143-241.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd to ip-10-0-138-45.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-cfmjw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cfmjw to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5 to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6 to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5 to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-processing-e2e-autores-152c50-865455876f-ckzmm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-152c50-865455876f-ckzmm to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f5267c-openshift-default-64f7468fd-4w6th to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-pm4dl

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-pm4dl to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7 to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw to ip-10-0-129-163.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t to ip-10-0-138-45.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-qnwdb to ip-10-0-138-45.ec2.internal

openshift-ingress

router-default-5895868fb6-s4mnj

Scheduled

Successfully assigned openshift-ingress/router-default-5895868fb6-s4mnj to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Scheduled

Successfully assigned openshift-ingress/e2e-autores-152c50-openshift-default-8479f4444b-mgbt8 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p to ip-10-0-129-163.ec2.internal

openshift-ingress

kube-auth-proxy-5586fdf7b-jxnn7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5586fdf7b-jxnn7 to ip-10-0-129-163.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9 to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5 to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8 to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl to ip-10-0-129-163.ec2.internal

openshift-ingress

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm to ip-10-0-138-45.ec2.internal

openshift-ingress

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx to ip-10-0-138-45.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-hjfht

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-hjfht to ip-10-0-138-45.ec2.internal

openshift-ingress

kube-auth-proxy-5586fdf7b-tz4vp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5586fdf7b-tz4vp to ip-10-0-143-241.ec2.internal

openshift-ingress

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj to ip-10-0-138-45.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5895868fb6 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-5895868fb6

FailedCreate

Error creating: pods "router-default-5895868fb6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5895868fb6

FailedCreate

Error creating: pods "router-default-5895868fb6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5895868fb6

SuccessfulCreate

Created pod: router-default-5895868fb6-s4mnj
(x5)

openshift-ingress

kubelet

router-default-5895868fb6-s4mnj

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x5)

openshift-ingress

kubelet

router-default-5895868fb6-s4mnj

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-5895868fb6-s4mnj

Started

Started container router

openshift-ingress

kubelet

router-default-5895868fb6-s4mnj

Created

Created container: router

openshift-ingress

kubelet

router-default-5895868fb6-s4mnj

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-5895868fb6-s4mnj

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5586fdf7b

SuccessfulCreate

Created pod: kube-auth-proxy-5586fdf7b-tz4vp

openshift-ingress

replicaset-controller

kube-auth-proxy-5586fdf7b

SuccessfulCreate

Created pod: kube-auth-proxy-5586fdf7b-jxnn7

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-tz4vp

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-jxnn7

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5586fdf7b from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-5586fdf7b

FailedCreate

Error creating: pods "kube-auth-proxy-5586fdf7b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-5586fdf7b-jxnn7

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-tz4vp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-jxnn7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-cfmjw

openshift-ingress

multus

kube-auth-proxy-5586fdf7b-tz4vp

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-cfmjw

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-jxnn7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-jxnn7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.673s (2.673s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-tz4vp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-tz4vp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-tz4vp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.676s (2.676s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5586fdf7b-jxnn7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.693s (3.693s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.62s (2.62s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xh8ch

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-nrvfw

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nrvfw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nrvfw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nrvfw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-nrvfw

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-cfmjw

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-cfmjw

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-qnwdb

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-pm4dl
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-hjfht

openshift-ingress

multus

payload-processing-5b54b7fbb7-pm4dl

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm4dl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-hjfht

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hjfht

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm4dl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.221s (2.221s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm4dl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hjfht

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.32s (2.32s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hjfht

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hjfht

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pm4dl

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-qnwdb

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-b7e4c1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-b7e4c1

openshift-ingress

multus

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-b7e4c1-openshift-default-5d45774946

SuccessfulCreate

Created pod: e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

openshift-ingress

deployment-controller

e2e-inf-a-b7e4c1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-b7e4c1-openshift-default-5d45774946 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b7e4c1: serviceaccount "payload-processing-e2e-inf-a-b7e4c1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-b7e4c1: serviceaccount "payload-processing-e2e-inf-a-b7e4c1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-b7e4c1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-b7e4c1-df7dc7cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-b7e4c1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-c30b7add-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c30b7add-openshift-default-56656fcf6d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-c30b7add

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c30b7add

openshift-ingress

replicaset-controller

e2e-ait-c30b7add-openshift-default-56656fcf6d

SuccessfulCreate

Created pod: e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

openshift-ingress

multus

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-152c50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-152c50-openshift-default-8479f4444b from 0 to 1
(x2)

openshift-ingress

GatewayAuthBootstrap

e2e-autores-152c50

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-152c50-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-152c50-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-autores-152c50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-152c50

openshift-ingress

replicaset-controller

e2e-autores-152c50-openshift-default-8479f4444b

SuccessfulCreate

Created pod: e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

openshift-ingress

multus

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.567s (2.567s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c30b7add-66d77958c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c30b7add-66d77958c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c30b7add-66d77958c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c30b7add: serviceaccount "payload-processing-e2e-ait-c30b7add" not found

openshift-ingress

multus

payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c30b7add

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c30b7add-66d77958c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c30b7add-7f4cfbb67

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c30b7add-7f4cfbb67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c30b7add: serviceaccount "payload-processing-e2e-ait-c30b7add" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c30b7add-7f4cfbb67

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c30b7add

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c30b7add-7f4cfbb67 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.601s (1.601s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-152c50-5d689bcdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-152c50-5d689bcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-152c50: serviceaccount "payload-processing-e2e-autores-152c50" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-152c50-865455876f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-152c50-865455876f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-152c50: serviceaccount "payload-processing-e2e-autores-152c50" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-152c50-865455876f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-152c50-865455876f-ckzmm

openshift-ingress

deployment-controller

payload-processing-e2e-autores-152c50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-152c50-865455876f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-152c50-5d689bcdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-152c50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-152c50-5d689bcdb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-autores-152c50-865455876f-ckzmm

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-autores-152c50-865455876f-ckzmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-152c50-865455876f-ckzmm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-152c50-865455876f-ckzmm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ef61c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ef61c5

openshift-ingress

replicaset-controller

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4

SuccessfulCreate

Created pod: e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

openshift-ingress

deployment-controller

e2e-inf-b-ef61c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4 from 0 to 1

openshift-ingress

multus

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ef61c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ef61c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ef61c5-5c9f57d88c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ef61c5: serviceaccount "payload-processing-e2e-inf-b-ef61c5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ef61c5: serviceaccount "payload-processing-e2e-inf-b-ef61c5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c30b7add-66d77958c8-2j8vl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-c30b7add-openshift-default-56656fcf6d-vq2fd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-c30b7add-7f4cfbb67-x4jfk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-c30b7add

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-c30b7add: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-c30b7add": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-c30b7add, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bc7067b0-3dbd-4949-bc77-0f281be4d428, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-migrate-25494d09-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-25494d09-gw

openshift-ingress

replicaset-controller

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd

SuccessfulCreate

Created pod: e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

openshift-ingress

deployment-controller

e2e-migrate-25494d09-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd from 0 to 1

openshift-ingress

multus

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-25494d09

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-25494d09-6c554d6774 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-25494d09: serviceaccount "payload-processing-e2e-migrate-25494d09" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-25494d09-6c554d6774

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-25494d09

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-25494d09-798dc5bd78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-25494d09-6c554d6774

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-25494d09-6c554d6774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-25494d09: serviceaccount "payload-processing-e2e-migrate-25494d09" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Unhealthy

Readiness probe failed: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

ProbeError

Readiness probe error: Get "http://10.133.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-25494d09-798dc5bd78-9mtdb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-25494d09-6c554d6774-vxkp6

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-5e86f370-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-5e86f370-openshift-default-567877f884 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-5e86f370-openshift-default-567877f884

SuccessfulCreate

Created pod: e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

openshift-ingress

kubelet

e2e-migrate-25494d09-gw-openshift-default-7b46b89cbd-58mrr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-5e86f370

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-5e86f370

openshift-ingress

multus

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-5e86f370

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-5e86f370-584895977d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5e86f370-78f98684f9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-5e86f370-78f98684f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5e86f370: serviceaccount "payload-processing-e2e-ait-5e86f370" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-5e86f370

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-5e86f370-78f98684f9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-5e86f370-78f98684f9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5e86f370-584895977d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-5e86f370-584895977d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-5e86f370: serviceaccount "payload-processing-e2e-ait-5e86f370" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-5e86f370-584895977d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-5e86f370-584895977d-8dthj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-5e86f370-78f98684f9-k6jc9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-derive-3f8729d3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3f8729d3-openshift-default-5f9f76477b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-3f8729d3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3f8729d3

openshift-ingress

replicaset-controller

e2e-derive-3f8729d3-openshift-default-5f9f76477b

SuccessfulCreate

Created pod: e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

openshift-ingress

kubelet

e2e-ait-5e86f370-openshift-default-567877f884-q4xd8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3f8729d3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3f8729d3: serviceaccount "payload-processing-e2e-derive-3f8729d3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3f8729d3-56df688cfc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3f8729d3-56df688cfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3f8729d3: serviceaccount "payload-processing-e2e-derive-3f8729d3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3f8729d3-56df688cfc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3f8729d3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3f8729d3-56df688cfc from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-autores-152c50-865455876f-ckzmm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-152c50-5d689bcdb-hv9kg

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-bf198c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-bf198c

openshift-ingress

kubelet

e2e-autores-152c50-openshift-default-8479f4444b-mgbt8

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-bf198c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-bf198c-openshift-default-7f4b8c6764 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-bf198c-openshift-default-7f4b8c6764

SuccessfulCreate

Created pod: e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3f8729d3-6978b6d6b6-rvmsn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-3f8729d3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-3f8729d3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-3f8729d3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-3f8729d3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5a405ccb-d267-44f6-8bd7-4560d592101e, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-3f8729d3-56df688cfc-6dcfc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-3f8729d3-openshift-default-5f9f76477b-mr4rj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-bf198c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-bf198c-7cc556c7fc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bf198c-7cc556c7fc

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-bf198c-7cc556c7fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bf198c: serviceaccount "payload-processing-e2e-explicit-bf198c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bf198c-7cc556c7fc

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-bf198c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-bf198c-5d79c744bb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bf198c: serviceaccount "payload-processing-e2e-explicit-bf198c" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bf198c-5d79c744bb-fk6pd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bf198c-7cc556c7fc-mb9w8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-f5267c-openshift-default-64f7468fd

SuccessfulCreate

Created pod: e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

openshift-ingress

deployment-controller

e2e-noten-f5267c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f5267c-openshift-default-64f7468fd from 0 to 1

openshift-ingress

kubelet

e2e-explicit-bf198c-openshift-default-7f4b8c6764-qhddm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-noten-f5267c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f5267c

openshift-ingress

gateway_labeler_controller

e2e-mt-d6b326a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d6b326a7

openshift-ingress

deployment-controller

e2e-mt-d6b326a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d6b326a7-openshift-default-6bdb644c4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-d6b326a7-openshift-default-6bdb644c4d

SuccessfulCreate

Created pod: e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

openshift-ingress

multus

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d6b326a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d6b326a7-74d55fd4b9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d6b326a7-74d55fd4b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d6b326a7: serviceaccount "payload-processing-e2e-mt-d6b326a7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d6b326a7-74d55fd4b9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d6b326a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d6b326a7-74d55fd4b9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d6b326a7: serviceaccount "payload-processing-e2e-mt-d6b326a7" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-noten-f5267c-openshift-default-64f7468fd-4w6th

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-b7e4c1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-b7e4c1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-b7e4c1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-b7e4c1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: bdebf3a7-9dc6-45db-9c46-07a092f9de9a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-b7e4c1-df7dc7cc-9lwvq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-b7e4c1-7fd68d75db-46dnw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-b7e4c1-openshift-default-5d45774946-dfsrx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ef61c5-66dd8dc678-cfnvc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ef61c5-5c9f57d88c-n2rj7

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-d6b326a7-74d55fd4b9-9sxq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-ef61c5-openshift-default-6f5f4cffb4-zg6l6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-6b944b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-6b944b

openshift-ingress

replicaset-controller

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd

SuccessfulCreate

Created pod: e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

openshift-ingress

deployment-controller

e2e-shared-a-w3-6b944b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d6b326a7-6c875d5f78-xrkdh

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6b944b: serviceaccount "payload-processing-e2e-shared-a-w3-6b944b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6b944b-759cf49565

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-6b944b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-6b944b-759cf49565 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6b944b-759cf49565

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-6b944b-759cf49565-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6b944b: serviceaccount "payload-processing-e2e-shared-a-w3-6b944b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-6b944b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-d6b326a7-openshift-default-6bdb644c4d-55j25

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd

SuccessfulCreate

Created pod: e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

openshift-ingress

deployment-controller

e2e-shared-a-w2-0c816d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-0c816d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-0c816d

openshift-ingress

multus

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-0c816d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-0c816d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-0c816d: serviceaccount "payload-processing-e2e-shared-a-w2-0c816d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-0c816d: serviceaccount "payload-processing-e2e-shared-a-w2-0c816d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-0f0a2f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-0f0a2f

openshift-ingress

replicaset-controller

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d

SuccessfulCreate

Created pod: e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

openshift-ingress

deployment-controller

e2e-shared-b-w3-0f0a2f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-0f0a2f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-0f0a2f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0f0a2f: serviceaccount "payload-processing-e2e-shared-b-w3-0f0a2f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0f0a2f: serviceaccount "payload-processing-e2e-shared-b-w3-0f0a2f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-2195e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-2195e0

openshift-ingress

replicaset-controller

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88

SuccessfulCreate

Created pod: e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

openshift-ingress

deployment-controller

e2e-shared-b-w2-2195e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-2195e0-openshift-default-fdf554f88 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-2195e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-2195e0-696897cb9f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2195e0: serviceaccount "payload-processing-e2e-shared-b-w2-2195e0" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-2195e0: serviceaccount "payload-processing-e2e-shared-b-w2-2195e0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-2195e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-8108f8fd-openshift-default-74c546d98d

SuccessfulCreate

Created pod: e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

openshift-ingress

deployment-controller

e2e-mt-8108f8fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8108f8fd-openshift-default-74c546d98d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-8108f8fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8108f8fd

openshift-ingress

multus

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8108f8fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8108f8fd-87dddb857

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8108f8fd: serviceaccount "payload-processing-e2e-mt-8108f8fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8108f8fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8108f8fd-87dddb857 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8108f8fd-87dddb857

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8108f8fd-87dddb857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8108f8fd: serviceaccount "payload-processing-e2e-mt-8108f8fd" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8108f8fd-dcc4f6b46-mqtsw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8108f8fd-87dddb857-8dv44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-8108f8fd-openshift-default-74c546d98d-4lgnc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-2cfab4-openshift-default-956f7bfcb

SuccessfulCreate

Created pod: e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

openshift-ingress

gateway_labeler_controller

e2e-api-a-2cfab4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-2cfab4

openshift-ingress

deployment-controller

e2e-api-a-2cfab4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-2cfab4-openshift-default-956f7bfcb from 0 to 1

openshift-ingress

multus

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2cfab4: serviceaccount "payload-processing-e2e-api-a-2cfab4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2cfab4-6b489798bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-2cfab4-6b489798bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-2cfab4: serviceaccount "payload-processing-e2e-api-a-2cfab4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-2cfab4-6b489798bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-2cfab4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-2cfab4-6b489798bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-2cfab4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-api-b-f57a16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f57a16-openshift-default-85d4d6f974 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-f57a16-openshift-default-85d4d6f974

SuccessfulCreate

Created pod: e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

openshift-ingress

gateway_labeler_controller

e2e-api-b-f57a16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f57a16

openshift-ingress

multus

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f57a16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f57a16-8649dbf69c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f57a16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

openshift-ingress

kubelet

payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f57a16-8649dbf69c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f57a16-8649dbf69c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f57a16: serviceaccount "payload-processing-e2e-api-b-f57a16" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f57a16-8649dbf69c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

openshift-ingress

kubelet

payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f57a16: serviceaccount "payload-processing-e2e-api-b-f57a16" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

Unhealthy

Startup probe failed: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

ProbeError

Startup probe error: Get "http://10.134.0.95:15021/healthz/ready": dial tcp 10.134.0.95:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-2cfab4-6fbf5cc9f8-tbg97

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-2cfab4-6b489798bc-prc9j

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-2cfab4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-2cfab4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-2cfab4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-2cfab4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b7d9bf75-2e49-4e87-bca3-e16a34e1c48e, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-2cfab4-openshift-default-956f7bfcb-gj84q

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-984178

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-984178

openshift-ingress

deployment-controller

e2e-ipp-a-984178-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-984178-openshift-default-5d8dfcd9b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8

SuccessfulCreate

Created pod: e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

openshift-ingress

multus

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-984178-695974bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-984178-695974bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-984178: serviceaccount "payload-processing-e2e-ipp-a-984178" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-984178

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-984178-695974bbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-984178-7964b67dcf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-984178-7964b67dcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-984178: serviceaccount "payload-processing-e2e-ipp-a-984178" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-984178

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-984178-7964b67dcf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-984178-695974bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f57a16-64c6fb8f94-dkbkz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f57a16-8649dbf69c-g4gdh

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-984178-7964b67dcf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-b-f57a16-openshift-default-85d4d6f974-7bdgq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-0c816d-74486dfcb9-pq9tj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-0c816d-59c976db46-zr96p

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f866d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f866d4

openshift-ingress

replicaset-controller

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b

SuccessfulCreate

Created pod: e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

openshift-ingress

multus

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

AddedInterface

Add eth0 [10.134.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-f866d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-0c816d-openshift-default-69d6cf7ccd-kg4xl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f866d4: serviceaccount "payload-processing-e2e-ipp-b-f866d4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f866d4: serviceaccount "payload-processing-e2e-ipp-b-f866d4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f866d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f866d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-2195e0-696897cb9f-5tjdx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-2195e0-67bc598c8b-ns6r6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-2195e0-openshift-default-fdf554f88-8znhz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

ProbeError

Startup probe error: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Unhealthy

Startup probe failed: Get "http://10.134.0.101:15021/healthz/ready": dial tcp 10.134.0.101:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86

SuccessfulCreate

Created pod: e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-55c3cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-55c3cf

openshift-ingress

deployment-controller

e2e-ipp-cleanup-55c3cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

AddedInterface

Add eth0 [10.134.0.105/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-55c3cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-55c3cf-596976c645 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-55c3cf: serviceaccount "payload-processing-e2e-ipp-cleanup-55c3cf" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-55c3cf: serviceaccount "payload-processing-e2e-ipp-cleanup-55c3cf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-55c3cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Unhealthy

Startup probe failed: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

ProbeError

Startup probe error: Get "http://10.134.0.105:15021/healthz/ready": dial tcp 10.134.0.105:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-55c3cf-d976b7c46-qd7w5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-55c3cf-596976c645-q5d5p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-55c3cf-openshift-default-5c7f966c86-294f7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-984178

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-984178: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-984178": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-984178, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9ebee2a1-a964-4e72-a66d-3cd01530bb75, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-984178-695974bbb-pzw8t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-984178-7964b67dcf-6zrfv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-984178-openshift-default-5d8dfcd9b8-htt2z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f866d4-56ccbf57cd-6bmkw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f866d4-65bc4c7bc9-wnt5k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-f866d4-openshift-default-5bfbfc7b5b-wsgqn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6b944b-64c8cdd84b-2zjm5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6b944b-759cf49565-xgjdh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-6b944b-openshift-default-7cb776f4fd-477f2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0f0a2f-85c77f59dc-vctmb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0f0a2f-57986bbdf8-sxnfj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-0f0a2f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0f0a2f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-0f0a2f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0f0a2f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 1a256ca0-bb87-4f95-a6d4-d2388d2e2622, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-0f0a2f-openshift-default-54b86dfc4d-hkc42

Killing

Stopping container istio-proxy