Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5 to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9 to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-jdjnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-jdjnk to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7 to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7 to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2 to ip-10-0-140-211.ec2.internal

openshift-ingress

router-default-68f69558bb-s4pcz

Scheduled

Successfully assigned openshift-ingress/router-default-68f69558bb-s4pcz to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8 to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f to ip-10-0-140-186.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt to ip-10-0-140-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-l9crn

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-l9crn to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr to ip-10-0-140-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-k9bx7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k9bx7 to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr to ip-10-0-140-211.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9z8xb to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-f858k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-f858k to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr to ip-10-0-140-211.ec2.internal

openshift-ingress

kube-auth-proxy-77c49cb9c9-mtb4x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-77c49cb9c9-mtb4x to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2 to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8 to ip-10-0-140-186.ec2.internal

openshift-ingress

kube-auth-proxy-77c49cb9c9-4kwsl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-77c49cb9c9-4kwsl to ip-10-0-138-96.ec2.internal

openshift-ingress

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95 to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5 to ip-10-0-138-96.ec2.internal

openshift-ingress

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Scheduled

Successfully assigned openshift-ingress/e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz to ip-10-0-140-211.ec2.internal

openshift-ingress

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9 to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4 to ip-10-0-140-186.ec2.internal

openshift-ingress

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l to ip-10-0-140-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw to ip-10-0-138-96.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln to ip-10-0-140-186.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph to ip-10-0-140-186.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-68f69558bb from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-68f69558bb

FailedCreate

Error creating: pods "router-default-68f69558bb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-68f69558bb

FailedCreate

Error creating: pods "router-default-68f69558bb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-68f69558bb

SuccessfulCreate

Created pod: router-default-68f69558bb-s4pcz
(x5)

openshift-ingress

kubelet

router-default-68f69558bb-s4pcz

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-68f69558bb-s4pcz

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-68f69558bb-s4pcz

Created

Created container: router

openshift-ingress

kubelet

router-default-68f69558bb-s4pcz

Started

Started container router

openshift-ingress

kubelet

router-default-68f69558bb-s4pcz

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-68f69558bb-s4pcz

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-77c49cb9c9 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-mtb4x

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-77c49cb9c9

FailedCreate

Error creating: pods "kube-auth-proxy-77c49cb9c9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-77c49cb9c9

SuccessfulCreate

Created pod: kube-auth-proxy-77c49cb9c9-mtb4x

openshift-ingress

replicaset-controller

kube-auth-proxy-77c49cb9c9

SuccessfulCreate

Created pod: kube-auth-proxy-77c49cb9c9-4kwsl

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-4kwsl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-77c49cb9c9-mtb4x

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-mtb4x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-77c49cb9c9-4kwsl

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-4kwsl

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-k9bx7

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-k9bx7

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-mtb4x

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-mtb4x

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-4kwsl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.868s (2.868s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-4kwsl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-4kwsl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77c49cb9c9-mtb4x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.924s (2.924s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k9bx7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k9bx7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k9bx7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.514s (2.514s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k9bx7

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.447s (2.447s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-fqhxt

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-l9crn

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-l9crn

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l9crn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l9crn

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l9crn

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l9crn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-l9crn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k9bx7

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-k9bx7

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9z8xb

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-jdjnk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-f858k

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-f858k

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-jdjnk

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdjnk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f858k

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdjnk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f858k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f858k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdjnk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-jdjnk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.708s (1.708s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-f858k

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.964s (1.964s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

Unhealthy

Readiness probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

ProbeError

Readiness probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

Unhealthy

Startup probe failed: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9z8xb

ProbeError

Startup probe error: Get "http://10.134.0.35:15021/healthz/ready": dial tcp 10.134.0.35:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-67477b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-67477b

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-67477b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-67477b-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-67477b-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-inf-a-67477b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-67477b-openshift-default-77b68cddcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-67477b-openshift-default-77b68cddcb

SuccessfulCreate

Created pod: e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

openshift-ingress

multus

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-67477b-9f59fb599

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-67477b-9f59fb599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-67477b: serviceaccount "payload-processing-e2e-inf-a-67477b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-67477b-9f59fb599

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-67477b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-67477b-9f59fb599 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-67477b-76d7b99898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-67477b-76d7b99898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-67477b: serviceaccount "payload-processing-e2e-inf-a-67477b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-67477b-76d7b99898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-67477b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-67477b-76d7b99898 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

GatewayAuthBootstrap

e2e-ait-f412cf1d

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-f412cf1d-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-f412cf1d-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-f412cf1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f412cf1d

openshift-ingress

deployment-controller

e2e-ait-f412cf1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f412cf1d-openshift-default-785495b954 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-5883b7-openshift-default-fd4fb7884

SuccessfulCreate

Created pod: e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

openshift-ingress

multus

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-5883b7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-5883b7

openshift-ingress

deployment-controller

e2e-autores-5883b7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-5883b7-openshift-default-fd4fb7884 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f412cf1d-openshift-default-785495b954

SuccessfulCreate

Created pod: e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

openshift-ingress

multus

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-5883b7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-5883b7-86dc7f9d47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-5883b7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-5883b7-b8c9745cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5883b7-b8c9745cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-5883b7-b8c9745cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-5883b7-b8c9745cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5883b7: serviceaccount "payload-processing-e2e-autores-5883b7" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5883b7-86dc7f9d47

FailedCreate

Error creating: pods "payload-processing-e2e-autores-5883b7-86dc7f9d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-5883b7: serviceaccount "payload-processing-e2e-autores-5883b7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-5883b7-86dc7f9d47

SuccessfulCreate

Created pod: payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f412cf1d: serviceaccount "payload-processing-e2e-ait-f412cf1d" not found

openshift-ingress

multus

payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f412cf1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f412cf1d: serviceaccount "payload-processing-e2e-ait-f412cf1d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f412cf1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

openshift-ingress

kubelet

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fb8c5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fb8c5d

openshift-ingress

deployment-controller

e2e-inf-b-fb8c5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fb8c5d-openshift-default-6fd844c848 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-fb8c5d-openshift-default-6fd844c848

SuccessfulCreate

Created pod: e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fb8c5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fb8c5d: serviceaccount "payload-processing-e2e-inf-b-fb8c5d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fb8c5d: serviceaccount "payload-processing-e2e-inf-b-fb8c5d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fb8c5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-f412cf1d-7dd7dcf9d9-6msfm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f412cf1d-6d7dc4b6f8-nb4g8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f412cf1d-openshift-default-785495b954-mbrm5

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d

SuccessfulCreate

Created pod: e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

openshift-ingress

gateway_labeler_controller

e2e-migrate-5d49a629-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-5d49a629-gw

openshift-ingress

deployment-controller

e2e-migrate-5d49a629-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d from 0 to 1

openshift-ingress

multus

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5d49a629: serviceaccount "payload-processing-e2e-migrate-5d49a629" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5d49a629-849874cb6b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-5d49a629

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-5d49a629-849874cb6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5d49a629-849874cb6b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-5d49a629-849874cb6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5d49a629: serviceaccount "payload-processing-e2e-migrate-5d49a629" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-5d49a629

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-5d49a629-8554dc887d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5d49a629-8554dc887d-mdqpm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5d49a629-849874cb6b-ftzkh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-migrate-5d49a629-gw-openshift-default-7499cc7c4d-65x7l

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ait-e436a33c-openshift-default-86b7dcc8bd

SuccessfulCreate

Created pod: e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

openshift-ingress

gateway_labeler_controller

e2e-ait-e436a33c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e436a33c

openshift-ingress

multus

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-e436a33c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e436a33c-openshift-default-86b7dcc8bd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e436a33c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e436a33c-74d8db6b8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e436a33c-74d8db6b8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e436a33c-7df896f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e436a33c-7df896f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e436a33c: serviceaccount "payload-processing-e2e-ait-e436a33c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e436a33c-7df896f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e436a33c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e436a33c-7df896f78 from 0 to 1
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e436a33c-74d8db6b8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e436a33c-74d8db6b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e436a33c: serviceaccount "payload-processing-e2e-ait-e436a33c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e436a33c-7df896f78-ddhfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e436a33c-74d8db6b8c-8cbbg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-e436a33c-openshift-default-86b7dcc8bd-dlxhm

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-c83b88f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c83b88f4

openshift-ingress

multus

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-c83b88f4-openshift-default-76945b7bd

SuccessfulCreate

Created pod: e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

openshift-ingress

deployment-controller

e2e-derive-c83b88f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c83b88f4-openshift-default-76945b7bd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c83b88f4-6784f96cc7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c83b88f4-6784f96cc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c83b88f4: serviceaccount "payload-processing-e2e-derive-c83b88f4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c83b88f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c83b88f4-6784f96cc7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c83b88f4: serviceaccount "payload-processing-e2e-derive-c83b88f4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c83b88f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c83b88f4-6f4545547d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c83b88f4-6784f96cc7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

openshift-ingress

kubelet

payload-processing-e2e-autores-5883b7-86dc7f9d47-2rqlg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-5883b7-b8c9745cd-wvwjg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c83b88f4-6f4545547d-d5ttc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-c83b88f4-openshift-default-76945b7bd-5xzkw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-c83b88f4-6784f96cc7-t78ql

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-c83b88f4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-c83b88f4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-c83b88f4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: edcc975f-7b16-4309-863a-06deddc91fd2, UID in object meta:

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-c69872-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c69872-openshift-default-7d58b95688 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c69872-openshift-default-7d58b95688

SuccessfulCreate

Created pod: e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

openshift-ingress

gateway_labeler_controller

e2e-explicit-c69872

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c69872

openshift-ingress

multus

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-5883b7-openshift-default-fd4fb7884-8zdsz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c69872

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c69872-7794d55df7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c69872-7794d55df7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c69872-7794d55df7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c69872-7794d55df7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c69872: serviceaccount "payload-processing-e2e-explicit-c69872" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c69872-c5988994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c69872-c5988994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c69872: serviceaccount "payload-processing-e2e-explicit-c69872" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c69872-c5988994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c69872

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c69872-c5988994 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-mt-045ac32d-openshift-default-7b75fbfc64

SuccessfulCreate

Created pod: e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

openshift-ingress

deployment-controller

e2e-mt-045ac32d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-045ac32d-openshift-default-7b75fbfc64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-045ac32d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-045ac32d

openshift-ingress

multus

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c69872-c5988994-kjmdn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c69872-7794d55df7-wwqgv

Killing

Stopping container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-045ac32d-7bb448df69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-045ac32d-7bb448df69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-045ac32d: serviceaccount "payload-processing-e2e-mt-045ac32d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-045ac32d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-045ac32d-7bb448df69 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-045ac32d-7bb448df69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-045ac32d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-045ac32d-8676dcd986 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-045ac32d-8676dcd986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-045ac32d-8676dcd986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-045ac32d-8676dcd986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-045ac32d: serviceaccount "payload-processing-e2e-mt-045ac32d" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-c0ad9c-openshift-default-7bc55d4568

SuccessfulCreate

Created pod: e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

openshift-ingress

deployment-controller

e2e-noten-c0ad9c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c0ad9c-openshift-default-7bc55d4568 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-c0ad9c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c0ad9c

openshift-ingress

kubelet

e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-c69872-openshift-default-7d58b95688-tqqk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-c0ad9c-openshift-default-7bc55d4568-v2cvm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-045ac32d-8676dcd986-jbc9f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-045ac32d-7bb448df69-9w4z2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-67477b-9f59fb599-6qqhf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-67477b-76d7b99898-q26zx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-045ac32d-openshift-default-7b75fbfc64-kqgrr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-67477b-openshift-default-77b68cddcb-hc9zw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb8c5d-fdf9bf6d7-rt9ln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb8c5d-b76b6c6f8-lrxv5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b

SuccessfulCreate

Created pod: e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

openshift-ingress

deployment-controller

e2e-shared-a-w2-fd32cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-fd32cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fd32cd

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w2-fd32cd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w2-fd32cd-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w2-fd32cd-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-386935

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-386935
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd: serviceaccount "payload-processing-e2e-shared-a-w2-fd32cd" not found

openshift-ingress

replicaset-controller

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84

SuccessfulCreate

Created pod: e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-fd32cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

openshift-ingress

deployment-controller

e2e-shared-a-w3-386935-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-fd32cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fd32cd: serviceaccount "payload-processing-e2e-shared-a-w2-fd32cd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-fb8c5d-openshift-default-6fd844c848-jrgwf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-386935-7567f67fd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-386935

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-386935-7567f67fd7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-386935

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-386935: serviceaccount "payload-processing-e2e-shared-a-w3-386935" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-386935-7567f67fd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-386935-7567f67fd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-386935: serviceaccount "payload-processing-e2e-shared-a-w3-386935" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Started

Started container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-f95803

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-f95803-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-f95803-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd

SuccessfulCreate

Created pod: e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

openshift-ingress

deployment-controller

e2e-shared-b-w2-f95803-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f95803-openshift-default-86c559d4cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f95803

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f95803

openshift-ingress

multus

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6

SuccessfulCreate

Created pod: e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3ebea5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3ebea5

openshift-ingress

deployment-controller

e2e-shared-b-w3-3ebea5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f95803

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f95803: serviceaccount "payload-processing-e2e-shared-b-w2-f95803" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f95803

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f95803-5f97f4896f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f95803: serviceaccount "payload-processing-e2e-shared-b-w2-f95803" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3ebea5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3ebea5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5: serviceaccount "payload-processing-e2e-shared-b-w3-3ebea5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3ebea5: serviceaccount "payload-processing-e2e-shared-b-w3-3ebea5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-7e61be66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7e61be66

openshift-ingress

deployment-controller

e2e-mt-7e61be66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7e61be66-openshift-default-5677bb6f7b from 0 to 1

openshift-ingress

multus

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-7e61be66-openshift-default-5677bb6f7b

SuccessfulCreate

Created pod: e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Started

Started container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e61be66-5448b9f645

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7e61be66-5448b9f645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e61be66: serviceaccount "payload-processing-e2e-mt-7e61be66" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7e61be66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7e61be66-7c6b49c894 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7e61be66: serviceaccount "payload-processing-e2e-mt-7e61be66" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7e61be66-5448b9f645

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7e61be66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7e61be66-5448b9f645 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.661s (1.661s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7e61be66-7c6b49c894-rcxdt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7e61be66-5448b9f645-zcbsc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7e61be66-openshift-default-5677bb6f7b-l8qps

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-api-a-6de04f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-6de04f-openshift-default-74c76478d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-6de04f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-6de04f

openshift-ingress

replicaset-controller

e2e-api-a-6de04f-openshift-default-74c76478d6

SuccessfulCreate

Created pod: e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

openshift-ingress

multus

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6de04f-85cd47cc7c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-6de04f-85cd47cc7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6de04f: serviceaccount "payload-processing-e2e-api-a-6de04f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-6de04f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-6de04f-7dc64cc978 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-6de04f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-6de04f-85cd47cc7c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-6de04f: serviceaccount "payload-processing-e2e-api-a-6de04f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-6de04f-85cd47cc7c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

openshift-ingress

multus

payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-api-b-f1705a

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-b-f1705a-authn-ssl: envoyfilters.networking.istio.io "e2e-api-b-f1705a-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-api-b-f1705a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-f1705a-openshift-default-54b979975d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-f1705a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-f1705a

openshift-ingress

replicaset-controller

e2e-api-b-f1705a-openshift-default-54b979975d

SuccessfulCreate

Created pod: e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

openshift-ingress

multus

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-f1705a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f1705a: serviceaccount "payload-processing-e2e-api-b-f1705a" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f1705a-7d87f8f57c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-f1705a-7d87f8f57c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-f1705a: serviceaccount "payload-processing-e2e-api-b-f1705a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-f1705a-7d87f8f57c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-f1705a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-f1705a-7d87f8f57c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-6de04f-7dc64cc978-2w6fw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-6de04f-85cd47cc7c-jz4c5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-6de04f-openshift-default-74c76478d6-kl6sr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-f1705a-7d87f8f57c-4b97v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-f1705a-75cdc4cc74-zmskk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-f1705a-openshift-default-54b979975d-rsmvq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fd32cd-64765b8c98-8hqk8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fd32cd-6689c7ccc7-dltqk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-fd32cd-openshift-default-5bd54f594b-d5f8b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f95803-5f97f4896f-45hsj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f95803-74fbc6f7cd-csck7

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-a-6ad962-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6ad962

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6ad962

openshift-ingress

replicaset-controller

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4

SuccessfulCreate

Created pod: e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

openshift-ingress

multus

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-f95803-openshift-default-86c559d4cd-62mf9

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6ad962

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6ad962-79999c7b9c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6ad962-79999c7b9c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6ad962-79999c7b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6ad962: serviceaccount "payload-processing-e2e-ipp-a-6ad962" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6ad962

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6ad962: serviceaccount "payload-processing-e2e-ipp-a-6ad962" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6ad962-79999c7b9c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-b54eb6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b54eb6-openshift-default-b58d49fd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b54eb6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b54eb6

openshift-ingress

replicaset-controller

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8

SuccessfulCreate

Created pod: e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

openshift-ingress

multus

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b54eb6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b54eb6-575695cb5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b54eb6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b54eb6-575695cb5f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b54eb6-575695cb5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b54eb6: serviceaccount "payload-processing-e2e-ipp-b-b54eb6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b54eb6-575695cb5f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b54eb6: serviceaccount "payload-processing-e2e-ipp-b-b54eb6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-4f951a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-4f951a-openshift-default-55b5475864 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-4f951a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-4f951a

openshift-ingress

multus

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864

SuccessfulCreate

Created pod: e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-4f951a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-4f951a-6748d68859 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4f951a: serviceaccount "payload-processing-e2e-ipp-cleanup-4f951a" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-4f951a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-4f951a: serviceaccount "payload-processing-e2e-ipp-cleanup-4f951a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-4f951a-54d87c9b58-bzhzx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-4f951a-6748d68859-z946g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-4f951a-openshift-default-55b5475864-5hkv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6ad962-79999c7b9c-6ztph

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-6ad962

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-6ad962: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-6ad962": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-6ad962, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5960665a-1831-4b06-86d5-7a2030f252a9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6ad962-58847bcbc8-cdtwq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-6ad962-openshift-default-9cdfdfcc4-x5tlr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b54eb6-575695cb5f-wbg95

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b54eb6-69c68cb446-2qcc4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-b54eb6-openshift-default-b58d49fd8-f5dk6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-386935-7567f67fd7-v4s5f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-386935-77b8ff9fb6-tdlrh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-386935-openshift-default-5cc6bf8c84-vp5sf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3ebea5-58fcdd845d-sbxr7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3ebea5-59c7dfb47-kn77v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-3ebea5-openshift-default-789d5c4df6-4f2h2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503