Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26 to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-kkjwl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92 to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh to ip-10-0-143-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59 to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln to ip-10-0-143-61.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d to ip-10-0-135-240.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-trp8s

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-trp8s to ip-10-0-143-61.ec2.internal

openshift-ingress

payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2 to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt to ip-10-0-143-61.ec2.internal

openshift-ingress

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs to ip-10-0-143-61.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8 to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm to ip-10-0-143-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8 to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427 to ip-10-0-135-240.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-xprr6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-xprr6 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

Scheduled

Successfully assigned openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8 to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc to ip-10-0-134-78.ec2.internal

openshift-ingress

router-default-77fb65d46d-j8tqb

Scheduled

Successfully assigned openshift-ingress/router-default-77fb65d46d-j8tqb to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr to ip-10-0-134-78.ec2.internal

openshift-ingress

kube-auth-proxy-7c6995f664-h9784

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c6995f664-h9784 to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s to ip-10-0-143-61.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-v54tt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-v54tt to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Scheduled

Successfully assigned openshift-ingress/e2e-autores-36c51d-openshift-default-589558d68b-njsdr to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8 to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt to ip-10-0-134-78.ec2.internal

openshift-ingress

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6 to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv to ip-10-0-134-78.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-nkwp8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8 to ip-10-0-134-78.ec2.internal

openshift-ingress

kube-auth-proxy-7c6995f664-vbm7s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c6995f664-vbm7s to ip-10-0-143-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm to ip-10-0-135-240.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh to ip-10-0-135-240.ec2.internal

openshift-ingress

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr to ip-10-0-134-78.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb to ip-10-0-135-240.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-77fb65d46d from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-77fb65d46d

FailedCreate

Error creating: pods "router-default-77fb65d46d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-77fb65d46d

FailedCreate

Error creating: pods "router-default-77fb65d46d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-77fb65d46d

SuccessfulCreate

Created pod: router-default-77fb65d46d-j8tqb
(x5)

openshift-ingress

kubelet

router-default-77fb65d46d-j8tqb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-77fb65d46d-j8tqb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-77fb65d46d-j8tqb

Started

Started container router

openshift-ingress

kubelet

router-default-77fb65d46d-j8tqb

Created

Created container: router

openshift-ingress

kubelet

router-default-77fb65d46d-j8tqb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-77fb65d46d-j8tqb

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6995f664

SuccessfulCreate

Created pod: kube-auth-proxy-7c6995f664-vbm7s

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7c6995f664 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7c6995f664-h9784

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-h9784

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-vbm7s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7c6995f664-vbm7s

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6995f664

SuccessfulCreate

Created pod: kube-auth-proxy-7c6995f664-h9784
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6995f664

FailedCreate

Error creating: pods "kube-auth-proxy-7c6995f664-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-nkwp8

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-nkwp8

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-vbm7s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.036s (3.036s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-vbm7s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-vbm7s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-h9784

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-h9784

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.993s (4.993s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-7c6995f664-h9784

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.486s (6.486s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-trp8s

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-trp8s

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-trp8s

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-trp8s

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.392s (2.392s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-trp8s

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-trp8s

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-trp8s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-trp8s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.443s (4.443s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-h78r4

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-nkwp8

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-nkwp8
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-xprr6

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-xprr6

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-kkjwl

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-kkjwl

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kkjwl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-v54tt

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v54tt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-v54tt

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kkjwl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kkjwl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kkjwl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.895s (1.895s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v54tt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v54tt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-v54tt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.91s (2.91s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xprr6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xprr6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xprr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xprr6

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-xprr6

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-28e012-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-28e012-openshift-default-7f79f998cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-28e012

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-28e012

openshift-ingress

replicaset-controller

e2e-inf-a-28e012-openshift-default-7f79f998cd

SuccessfulCreate

Created pod: e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

openshift-ingress

multus

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-28e012-79c476cddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-28e012-79c476cddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-28e012: serviceaccount "payload-processing-e2e-inf-a-28e012" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-28e012

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-28e012-6f6bdb4b9c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-28e012: serviceaccount "payload-processing-e2e-inf-a-28e012" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-28e012

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-28e012-79c476cddb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-28e012-79c476cddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

openshift-ingress

multus

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8

Created

Created container: payload-processing

openshift-ingress

multus

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-f1f0ac73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f1f0ac73-openshift-default-5944485d9d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f1f0ac73-openshift-default-5944485d9d

SuccessfulCreate

Created pod: e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

openshift-ingress

gateway_labeler_controller

e2e-ait-f1f0ac73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f1f0ac73

openshift-ingress

replicaset-controller

e2e-autores-36c51d-openshift-default-589558d68b

SuccessfulCreate

Created pod: e2e-autores-36c51d-openshift-default-589558d68b-njsdr

openshift-ingress

gateway_labeler_controller

e2e-autores-36c51d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-36c51d

openshift-ingress

deployment-controller

e2e-autores-36c51d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-36c51d-openshift-default-589558d68b from 0 to 1

openshift-ingress

multus

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f1f0ac73-68cf85d9c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f1f0ac73-68cf85d9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f1f0ac73: serviceaccount "payload-processing-e2e-ait-f1f0ac73" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f1f0ac73-797485c498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f1f0ac73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f1f0ac73-68cf85d9c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f1f0ac73-68cf85d9c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f1f0ac73-797485c498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f1f0ac73-797485c498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f1f0ac73: serviceaccount "payload-processing-e2e-ait-f1f0ac73" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f1f0ac73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f1f0ac73-797485c498 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-36c51d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-36c51d-5bf86664d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-36c51d-5bf86664d9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-36c51d-5bf86664d9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-36c51d-5bf86664d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-36c51d: serviceaccount "payload-processing-e2e-autores-36c51d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-36c51d: serviceaccount "payload-processing-e2e-autores-36c51d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-36c51d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-a057c5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a057c5-openshift-default-5f564fb8cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a057c5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a057c5

openshift-ingress

replicaset-controller

e2e-inf-b-a057c5-openshift-default-5f564fb8cd

SuccessfulCreate

Created pod: e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.113s (3.113s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a057c5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a057c5-5b9fff87bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a057c5: serviceaccount "payload-processing-e2e-inf-b-a057c5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a057c5-5b9fff87bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a057c5-5b9fff87bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a057c5: serviceaccount "payload-processing-e2e-inf-b-a057c5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a057c5-5b9fff87bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a057c5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f1f0ac73-openshift-default-5944485d9d-n2t4j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f1f0ac73

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f1f0ac73": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18262471-8adb-475e-9d11-0440dd6d4bfd, UID in object meta:

openshift-ingress

replicaset-controller

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd

SuccessfulCreate

Created pod: e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

openshift-ingress

deployment-controller

e2e-migrate-13162f1c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-13162f1c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-13162f1c-gw

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.136s (3.136s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-13162f1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-13162f1c-5f56947dcd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-13162f1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-13162f1c: serviceaccount "payload-processing-e2e-migrate-13162f1c" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-13162f1c-5f56947dcd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-13162f1c-5f56947dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-13162f1c: serviceaccount "payload-processing-e2e-migrate-13162f1c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-13162f1c-5f56947dcd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

openshift-ingress

kubelet

payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

ProbeError

Startup probe error: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Unhealthy

Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-13162f1c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-13162f1c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-13162f1c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-13162f1c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 57ecd655-c85d-4083-b6d8-ffe31cb26755, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-13162f1c-5b59c87c6b-24p6d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-ddd2c784-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ddd2c784-openshift-default-864658c8b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-ddd2c784-openshift-default-864658c8b4

SuccessfulCreate

Created pod: e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

openshift-ingress

gateway_labeler_controller

e2e-ait-ddd2c784

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ddd2c784

openshift-ingress

multus

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ddd2c784-575dbd96b7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ddd2c784

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ddd2c784-575dbd96b7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ddd2c784-575dbd96b7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ddd2c784-575dbd96b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ddd2c784: serviceaccount "payload-processing-e2e-ait-ddd2c784" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ddd2c784

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ddd2c784: serviceaccount "payload-processing-e2e-ait-ddd2c784" not found

openshift-ingress

multus

payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ddd2c784-78b6bf9dd6-rgq5c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-a82afc10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a82afc10

openshift-ingress

deployment-controller

e2e-derive-a82afc10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a82afc10-openshift-default-8b4cf6bc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-a82afc10-openshift-default-8b4cf6bc6

SuccessfulCreate

Created pod: e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

openshift-ingress

multus

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a82afc10-6c66bdf85c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a82afc10-f5557f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a82afc10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a82afc10-6c66bdf85c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a82afc10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a82afc10-f5557f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a82afc10-6c66bdf85c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a82afc10-6c66bdf85c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a82afc10: serviceaccount "payload-processing-e2e-derive-a82afc10" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a82afc10-f5557f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a82afc10-f5557f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a82afc10: serviceaccount "payload-processing-e2e-derive-a82afc10" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a82afc10-6c66bdf85c-brfcn

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-a82afc10

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-a82afc10: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-a82afc10": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-a82afc10, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9d4e92a0-2b75-4e3f-ac0a-df2e4a7295b9, UID in object meta:

openshift-ingress

kubelet

e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-36c51d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-36c51d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-36c51d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-36c51d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d9306f1c-4c23-46ea-90b5-dd554650339d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-36c51d-7bbcd4dfdb-dbhh5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-bb8457-openshift-default-6d566b688

SuccessfulCreate

Created pod: e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

openshift-ingress

deployment-controller

e2e-explicit-bb8457-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-bb8457-openshift-default-6d566b688 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-bb8457

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-bb8457

openshift-ingress

multus

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-bb8457

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-bb8457-8494574dd9 from 0 to 1

openshift-ingress

kubelet

e2e-autores-36c51d-openshift-default-589558d68b-njsdr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bb8457-7b55598478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-bb8457-7b55598478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bb8457: serviceaccount "payload-processing-e2e-explicit-bb8457" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bb8457-8494574dd9

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-bb8457

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-bb8457-7b55598478 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-bb8457-8494574dd9

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-bb8457-8494574dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-bb8457: serviceaccount "payload-processing-e2e-explicit-bb8457" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-bb8457-7b55598478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

openshift-ingress

kubelet

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4

SuccessfulCreate

Created pod: e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

openshift-ingress

deployment-controller

e2e-mt-bbf4a143-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-bbf4a143

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-bbf4a143

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

openshift-ingress

multus

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-bbf4a143

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bbf4a143: serviceaccount "payload-processing-e2e-mt-bbf4a143" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bbf4a143: serviceaccount "payload-processing-e2e-mt-bbf4a143" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-bbf4a143

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-bb8457-7b55598478-fmzmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr

Unhealthy

Readiness probe failed: dial tcp 10.132.0.67:9004: i/o timeout

openshift-ingress

kubelet

e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-noten-69ef67

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-69ef67-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-69ef67-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-noten-69ef67-openshift-default-699b6ff6f8

SuccessfulCreate

Created pod: e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

openshift-ingress

deployment-controller

e2e-noten-69ef67-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-69ef67-openshift-default-699b6ff6f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-69ef67

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-69ef67

openshift-ingress

kubelet

e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bbf4a143-5bd8ffd4c7-cg9kw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-be2aba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-be2aba-openshift-default-865869f8bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-be2aba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-be2aba

openshift-ingress

kubelet

e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd

SuccessfulCreate

Created pod: e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

openshift-ingress

multus

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-be2aba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba: serviceaccount "payload-processing-e2e-shared-a-w2-be2aba" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba: serviceaccount "payload-processing-e2e-shared-a-w2-be2aba" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-be2aba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

Started

Started container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-28e012

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-28e012: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-28e012": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-28e012, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0b19bf68-fa82-4235-9c2f-036883d4280b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28e012-79c476cddb-8rfgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28e012-6f6bdb4b9c-k24r8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-28e012-openshift-default-7f79f998cd-vdpqd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a057c5-5b9fff87bf-b2kdn

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-0ac386

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-0ac386

openshift-ingress

deployment-controller

e2e-shared-b-w2-0ac386-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998

SuccessfulCreate

Created pod: e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0ac386: serviceaccount "payload-processing-e2e-shared-b-w2-0ac386" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-0ac386

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-0ac386

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-0ac386-6859769877 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0ac386-6859769877

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0ac386-6859769877

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-0ac386-6859769877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0ac386: serviceaccount "payload-processing-e2e-shared-b-w2-0ac386" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-a057c5-openshift-default-5f564fb8cd-2mflt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd

SuccessfulCreate

Created pod: e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

openshift-ingress

deployment-controller

e2e-shared-a-w3-b30e99-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-b30e99

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-b30e99

openshift-ingress

multus

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-b30e99

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b30e99: serviceaccount "payload-processing-e2e-shared-a-w3-b30e99" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-b30e99

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b30e99: serviceaccount "payload-processing-e2e-shared-a-w3-b30e99" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Unhealthy

Readiness probe failed: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

ProbeError

Readiness probe error: Get "http://10.133.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-642d3b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-642d3b

openshift-ingress

deployment-controller

e2e-shared-b-w3-642d3b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-642d3b-openshift-default-596967c6f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6

SuccessfulCreate

Created pod: e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

openshift-ingress

multus

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-642d3b: serviceaccount "payload-processing-e2e-shared-b-w3-642d3b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-642d3b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-642d3b: serviceaccount "payload-processing-e2e-shared-b-w3-642d3b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-642d3b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-mt-7eb8750f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7eb8750f

openshift-ingress

deployment-controller

e2e-mt-7eb8750f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7eb8750f-openshift-default-76c7db7d88 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-7eb8750f-openshift-default-76c7db7d88

SuccessfulCreate

Created pod: e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd

Started

Started container payload-processing

openshift-ingress

multus

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7eb8750f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7eb8750f-64799f978f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7eb8750f-64799f978f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7eb8750f-64799f978f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7eb8750f: serviceaccount "payload-processing-e2e-mt-7eb8750f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7eb8750f: serviceaccount "payload-processing-e2e-mt-7eb8750f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7eb8750f-64799f978f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7eb8750f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-7eb8750f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-7eb8750f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2689a397-ad9c-46d0-86d1-6db24829e184, UID in object meta:

openshift-ingress

kubelet

e2e-mt-7eb8750f-openshift-default-76c7db7d88-cnfsh

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-dfa395-openshift-default-799698ff7b

SuccessfulCreate

Created pod: e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

openshift-ingress

gateway_labeler_controller

e2e-api-a-dfa395

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dfa395

openshift-ingress

deployment-controller

e2e-api-a-dfa395-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dfa395-openshift-default-799698ff7b from 0 to 1

openshift-ingress

multus

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dfa395

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dfa395-6b68b5db75 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dfa395-6b68b5db75

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dfa395-6b68b5db75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dfa395: serviceaccount "payload-processing-e2e-api-a-dfa395" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dfa395: serviceaccount "payload-processing-e2e-api-a-dfa395" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dfa395

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

openshift-ingress

kubelet

payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dfa395-6b68b5db75

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-9a16f5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9a16f5-openshift-default-65ff96fd54 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-9a16f5-openshift-default-65ff96fd54

SuccessfulCreate

Created pod: e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

openshift-ingress

gateway_labeler_controller

e2e-api-b-9a16f5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9a16f5
(x5)

openshift-ingress

kubelet

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9a16f5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9a16f5-665d989fcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9a16f5: serviceaccount "payload-processing-e2e-api-b-9a16f5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9a16f5-74ccdf7f49

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9a16f5-74ccdf7f49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9a16f5: serviceaccount "payload-processing-e2e-api-b-9a16f5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9a16f5-74ccdf7f49

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9a16f5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9a16f5-74ccdf7f49 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-dfa395-openshift-default-799698ff7b-lkxcs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9a16f5-665d989fcd-b5pck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9a16f5-74ccdf7f49-wlcz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-be2aba

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-be2aba": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e9b2edef-9ee5-4e10-aa49-e15d057912ba, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-be2aba-openshift-default-865869f8bd-ft79s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0ac386-6859769877-4fkk4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0ac386-59c4d6455d-bvwxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-0ac386-openshift-default-5fbf7cc998-j978d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-e0da5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-e0da5a-openshift-default-f568fcb74 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-e0da5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-e0da5a

openshift-ingress

multus

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-e0da5a-openshift-default-f568fcb74

SuccessfulCreate

Created pod: e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e0da5a: serviceaccount "payload-processing-e2e-ipp-a-e0da5a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-e0da5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-e0da5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-e0da5a-5768455f65 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e0da5a-5768455f65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-e0da5a-5768455f65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-e0da5a-5768455f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-e0da5a: serviceaccount "payload-processing-e2e-ipp-a-e0da5a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-a3a348-openshift-default-888d95576

SuccessfulCreate

Created pod: e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

openshift-ingress

deployment-controller

e2e-ipp-b-a3a348-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a3a348-openshift-default-888d95576 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a3a348

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a3a348

openshift-ingress

multus

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a3a348

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a3a348

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a3a348-576b764df5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a3a348-576b764df5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

openshift-ingress

multus

payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a3a348: serviceaccount "payload-processing-e2e-ipp-b-a3a348" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a3a348-576b764df5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a3a348-576b764df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a3a348: serviceaccount "payload-processing-e2e-ipp-b-a3a348" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-7a907b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-7a907b-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-7a907b-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-7a907b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-7a907b

openshift-ingress

deployment-controller

e2e-ipp-cleanup-7a907b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

openshift-ingress

multus

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

AddedInterface

Add eth0 [10.132.0.93/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b: serviceaccount "payload-processing-e2e-ipp-cleanup-7a907b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-7a907b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b: serviceaccount "payload-processing-e2e-ipp-cleanup-7a907b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-7a907b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Unhealthy

Startup probe failed: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

ProbeError

Startup probe error: Get "http://10.132.0.93:15021/healthz/ready": dial tcp 10.132.0.93:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-e0da5a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-e0da5a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 98ea16db-eba6-40e1-89b6-fdf932fd7de6, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a3a348-openshift-default-888d95576-zz4tm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b30e99-69b8fb9567-62427

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b30e99-665cf768fd-cvcdm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-b30e99-openshift-default-6d4c67cbd-t6z92

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-642d3b-65c8b4d7b7-c6dvd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-642d3b-6796cc7d58-f7bvb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-642d3b-openshift-default-596967c6f6-pxbln

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503