Time Namespace Component RelatedObject Reason Message

openshift-ingress

router-default-585fc78676-kqsfm

Scheduled

Successfully assigned openshift-ingress/router-default-585fc78676-kqsfm to ip-10-0-138-83.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-nld96

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nld96 to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7 to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69 to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6 to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7 to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2 to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9 to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-76f657cdc4-p72fm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-76f657cdc4-p72fm to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-qt49s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-qt49s to ip-10-0-138-83.ec2.internal

openshift-ingress

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977 to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9 to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6 to ip-10-0-138-83.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-xnxq2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xnxq2 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92 to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-7xstn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7xstn to ip-10-0-138-83.ec2.internal

openshift-ingress

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd to ip-10-0-130-87.ec2.internal

openshift-ingress

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8be734-openshift-default-77769678-ppnbx to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-85fd65c94c-wh5fn

Scheduled

Successfully assigned openshift-ingress/payload-processing-85fd65c94c-wh5fn to ip-10-0-138-83.ec2.internal

openshift-ingress

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4 to ip-10-0-130-87.ec2.internal

openshift-ingress

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh to ip-10-0-138-83.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-b92x9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-b92x9 to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd to ip-10-0-138-83.ec2.internal

openshift-ingress

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9 to ip-10-0-130-87.ec2.internal

openshift-ingress

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

Scheduled

Successfully assigned openshift-ingress/e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm to ip-10-0-138-83.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn to ip-10-0-138-83.ec2.internal

openshift-ingress

payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5 to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48 to ip-10-0-138-83.ec2.internal

openshift-ingress

kube-auth-proxy-6c5f54bcb9-mmxtz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6c5f54bcb9-mmxtz to ip-10-0-136-54.ec2.internal

openshift-ingress

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h to ip-10-0-138-83.ec2.internal

openshift-ingress

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps to ip-10-0-136-54.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt to ip-10-0-130-87.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8 to ip-10-0-130-87.ec2.internal

openshift-ingress

kube-auth-proxy-6c5f54bcb9-dtvxf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6c5f54bcb9-dtvxf to ip-10-0-130-87.ec2.internal

openshift-ingress

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c to ip-10-0-138-83.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-585fc78676 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

router-default-585fc78676

FailedCreate

Error creating: pods "router-default-585fc78676-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-585fc78676

FailedCreate

Error creating: pods "router-default-585fc78676-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-585fc78676

SuccessfulCreate

Created pod: router-default-585fc78676-kqsfm
(x5)

openshift-ingress

kubelet

router-default-585fc78676-kqsfm

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-585fc78676-kqsfm

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-585fc78676-kqsfm

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-585fc78676-kqsfm

AddedInterface

Add eth0 [10.134.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-585fc78676-kqsfm

Started

Started container router

openshift-ingress

kubelet

router-default-585fc78676-kqsfm

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-6c5f54bcb9

SuccessfulCreate

Created pod: kube-auth-proxy-6c5f54bcb9-mmxtz

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6c5f54bcb9 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-6c5f54bcb9

SuccessfulCreate

Created pod: kube-auth-proxy-6c5f54bcb9-dtvxf
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-6c5f54bcb9

FailedCreate

Error creating: pods "kube-auth-proxy-6c5f54bcb9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-6c5f54bcb9-mmxtz

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6c5f54bcb9-dtvxf

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-xnxq2

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-mmxtz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-dtvxf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-xnxq2

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-dtvxf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.698s (2.698s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-dtvxf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-dtvxf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-mmxtz

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-mmxtz

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6c5f54bcb9-mmxtz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.881s (2.881s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.431s (3.432s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.215s (3.215s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-57kmn

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-b92x9

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-b92x9

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b92x9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b92x9

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-b92x9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xnxq2

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-xnxq2
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-nld96

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-nld96

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.418s (4.418s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-qt49s

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7xstn

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7xstn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-qt49s

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qt49s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-7xstn

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7xstn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.264s (1.264s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qt49s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.308s (1.308s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7xstn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7xstn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qt49s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qt49s

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

ProbeError

Startup probe error: Get "http://10.132.0.24:15021/healthz/ready": dial tcp 10.132.0.24:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nld96

Unhealthy

Startup probe failed: Get "http://10.132.0.24:15021/healthz/ready": dial tcp 10.132.0.24:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qt49s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7xstn

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-76f657cdc4

SuccessfulCreate

Created pod: payload-pre-processing-76f657cdc4-p72fm

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-85fd65c94c from 0 to 1

openshift-ingress

multus

payload-processing-85fd65c94c-wh5fn

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-85fd65c94c

SuccessfulCreate

Created pod: payload-processing-85fd65c94c-wh5fn

openshift-ingress

kubelet

payload-processing-85fd65c94c-wh5fn

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-76f657cdc4-p72fm

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-76f657cdc4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-p72fm

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-processing-85fd65c94c-wh5fn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-p72fm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-wh5fn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-p72fm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 967ms (967ms including waiting). Image size: 141094894 bytes.

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-p72fm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-85fd65c94c-wh5fn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.007s (1.007s including waiting). Image size: 141094894 bytes.

openshift-ingress

deployment-controller

e2e-worker-w0-8be734-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8be734-openshift-default-77769678 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-8be734

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-8be734

openshift-ingress

deployment-controller

e2e-worker-w3-cc98e0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-cc98e0-openshift-default-656b649fd6 from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-d8d689-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d8d689-openshift-default-5847cf4968 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-8be734-openshift-default-77769678

SuccessfulCreate

Created pod: e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

openshift-ingress

replicaset-controller

e2e-inf-a-d8d689-openshift-default-5847cf4968

SuccessfulCreate

Created pod: e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d8d689

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d8d689

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-cc98e0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-cc98e0

openshift-ingress

replicaset-controller

e2e-worker-w3-cc98e0-openshift-default-656b649fd6

SuccessfulCreate

Created pod: e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

openshift-ingress

multus

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8be734: serviceaccount "payload-processing-e2e-worker-w0-8be734" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8be734-776b56bf6f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-8be734-776b56bf6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8be734: serviceaccount "payload-processing-e2e-worker-w0-8be734" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-8be734

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-8be734-777dc4db98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8be734-776b56bf6f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-8be734

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-8be734-776b56bf6f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-cc98e0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-cc98e0-56597c87f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-cc98e0-56597c87f7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-cc98e0-56597c87f7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-cc98e0-56597c87f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-cc98e0: serviceaccount "payload-processing-e2e-worker-w3-cc98e0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-cc98e0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-cc98e0: serviceaccount "payload-processing-e2e-worker-w3-cc98e0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d8d689

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d8d689-5f57947d54 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d8d689

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d8d689-6476cbd8dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d8d689-6476cbd8dc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d8d689-6476cbd8dc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d8d689-6476cbd8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d8d689: serviceaccount "payload-processing-e2e-inf-a-d8d689" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d8d689: serviceaccount "payload-processing-e2e-inf-a-d8d689" not found

openshift-ingress

gateway_labeler_controller

e2e-ait-4889635f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4889635f

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 569ms (569ms including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-4889635f-openshift-default-5857cf4c46

SuccessfulCreate

Created pod: e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

openshift-ingress

deployment-controller

e2e-ait-4889635f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4889635f-openshift-default-5857cf4c46 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.373s (1.373s including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

Started

Started container payload-processing

openshift-ingress

multus

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4889635f-6f8978984f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4889635f-6f8978984f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4889635f-6f8978984f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4889635f: serviceaccount "payload-processing-e2e-ait-4889635f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4889635f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4889635f-6f8978984f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4889635f: serviceaccount "payload-processing-e2e-ait-4889635f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4889635f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4889635f-6cdd45dc8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

ProbeError

Readiness probe error: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d370b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d370b3

openshift-ingress

deployment-controller

e2e-inf-b-d370b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d370b3-openshift-default-5fd9d6c4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b

SuccessfulCreate

Created pod: e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

openshift-ingress

multus

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d370b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d370b3-586f59b9bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d370b3: serviceaccount "payload-processing-e2e-inf-b-d370b3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d370b3-586f59b9bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d370b3-586f59b9bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d370b3: serviceaccount "payload-processing-e2e-inf-b-d370b3" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d370b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d370b3-586f59b9bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

openshift-ingress

kubelet

payload-processing-e2e-ait-4889635f-6f8978984f-v2ngb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4889635f-6cdd45dc8-tz6lr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-4889635f-openshift-default-5857cf4c46-2h4d2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-c7f22faa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-c7f22faa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c7f22faa-gw

openshift-ingress

replicaset-controller

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96

SuccessfulCreate

Created pod: e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

openshift-ingress

multus

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c7f22faa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c7f22faa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c7f22faa-757994fdbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c7f22faa-757994fdbb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c7f22faa-757994fdbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c7f22faa: serviceaccount "payload-processing-e2e-migrate-c7f22faa" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c7f22faa-757994fdbb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c7f22faa: serviceaccount "payload-processing-e2e-migrate-c7f22faa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c7f22faa-54b8cd9b74-nk9qc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c7f22faa-757994fdbb-hbfv7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-c7f22faa-gw-openshift-default-6d756f9b96-5855h

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-c9cf09ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c9cf09ef

openshift-ingress

replicaset-controller

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd

SuccessfulCreate

Created pod: e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

openshift-ingress

multus

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-c9cf09ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c9cf09ef-openshift-default-b77fcbbcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c9cf09ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c9cf09ef-645c5654df from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c9cf09ef: serviceaccount "payload-processing-e2e-ait-c9cf09ef" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c9cf09ef-645c5654df

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c9cf09ef-645c5654df

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c9cf09ef-645c5654df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c9cf09ef: serviceaccount "payload-processing-e2e-ait-c9cf09ef" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c9cf09ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

openshift-ingress

kubelet

payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c9cf09ef-67fdbcb5bb-nnqdt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-c9cf09ef-645c5654df-frgdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-c9cf09ef-openshift-default-b77fcbbcd-kwrk2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-5f24c314

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-5f24c314

openshift-ingress

deployment-controller

e2e-derive-5f24c314-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-5f24c314-openshift-default-f68dc9444 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-5f24c314-openshift-default-f68dc9444

SuccessfulCreate

Created pod: e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

openshift-ingress

multus

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-5f24c314

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-5f24c314-644fdf8b78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-5f24c314

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-5f24c314-6bc6d78d97 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5f24c314-6bc6d78d97

FailedCreate

Error creating: pods "payload-processing-e2e-derive-5f24c314-6bc6d78d97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5f24c314: serviceaccount "payload-processing-e2e-derive-5f24c314" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5f24c314: serviceaccount "payload-processing-e2e-derive-5f24c314" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5f24c314-6bc6d78d97

SuccessfulCreate

Created pod: payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

openshift-ingress

kubelet

payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-5f24c314

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-5f24c314: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-5f24c314": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-5f24c314, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18ef2dca-ef67-441b-a822-7a8c6720b129, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-derive-5f24c314-6bc6d78d97-ndhs5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5f24c314-644fdf8b78-6k8ph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-5f24c314-openshift-default-f68dc9444-tp4fm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-07942c61-openshift-default-84584dcf44

SuccessfulCreate

Created pod: e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

openshift-ingress

deployment-controller

e2e-mt-07942c61-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-07942c61-openshift-default-84584dcf44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-07942c61

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-07942c61

openshift-ingress

multus

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-07942c61: serviceaccount "payload-processing-e2e-mt-07942c61" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

openshift-ingress

deployment-controller

payload-processing-e2e-mt-07942c61

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-07942c61-784b8b7dd9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-07942c61-784b8b7dd9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-07942c61

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-07942c61-7db64c7bb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-07942c61-784b8b7dd9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-07942c61-784b8b7dd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-07942c61: serviceaccount "payload-processing-e2e-mt-07942c61" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-07942c61-784b8b7dd9-ggx48

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-07942c61-7db64c7bb6-spwpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-mt-07942c61-openshift-default-84584dcf44-7kvqh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w1-474b22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-474b22-openshift-default-c79bf6646 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-474b22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-474b22

openshift-ingress

replicaset-controller

e2e-shared-a-w1-474b22-openshift-default-c79bf6646

SuccessfulCreate

Created pod: e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

openshift-ingress

multus

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-474b22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-474b22-68f48b46df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-474b22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-474b22-68f48b46df

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-474b22-68f48b46df

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-474b22-68f48b46df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-474b22: serviceaccount "payload-processing-e2e-shared-a-w1-474b22" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-474b22: serviceaccount "payload-processing-e2e-shared-a-w1-474b22" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-d8d689

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-d8d689: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-d8d689": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-d8d689, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e7fc890f-7827-4472-a103-f8a7ed7a238f, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d8d689-6476cbd8dc-pxm8c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d8d689-5f57947d54-wxlb7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-d8d689-openshift-default-5847cf4968-pr26c

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w1-725559-openshift-default-546b55fdfb

SuccessfulCreate

Created pod: e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

openshift-ingress

deployment-controller

e2e-shared-b-w1-725559-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-725559-openshift-default-546b55fdfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-725559

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-725559

openshift-ingress

multus

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d370b3-586f59b9bf-n8fmc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d370b3-96bc7b5db-s9dqv

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-725559-8689b64ff5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-725559

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-725559-855ffff598 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-725559: serviceaccount "payload-processing-e2e-shared-b-w1-725559" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-725559-8689b64ff5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-725559-8689b64ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-725559: serviceaccount "payload-processing-e2e-shared-b-w1-725559" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-725559

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-725559-8689b64ff5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-fcd402

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fcd402

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd

SuccessfulCreate

Created pod: e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

openshift-ingress

deployment-controller

e2e-shared-a-w2-fcd402-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-d370b3-openshift-default-5fd9d6c4b-ld7ql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fcd402-7755db5695

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-fcd402-7755db5695-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402: serviceaccount "payload-processing-e2e-shared-a-w2-fcd402" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-fcd402

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fcd402: serviceaccount "payload-processing-e2e-shared-a-w2-fcd402" not found
(x6)

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-fcd402

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-fcd402-7755db5695 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fcd402-7755db5695

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-2a1db100-openshift-default-84dc975848

SuccessfulCreate

Created pod: e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

openshift-ingress

deployment-controller

e2e-mt-2a1db100-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2a1db100-openshift-default-84dc975848 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-2a1db100

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2a1db100
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8

SuccessfulCreate

Created pod: e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2a1db100-5867d996b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-361849

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-361849
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2a1db100-5867d996b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2a1db100-5867d996b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2a1db100: serviceaccount "payload-processing-e2e-mt-2a1db100" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2a1db100-75b7486f57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2a1db100

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2a1db100-75b7486f57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2a1db100-75b7486f57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2a1db100-75b7486f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2a1db100: serviceaccount "payload-processing-e2e-mt-2a1db100" not found

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-361849

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-361849-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-361849-authn-ssl" already exists

openshift-ingress

multus

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-361849-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-361849-openshift-default-69cfffbbc8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2a1db100

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2a1db100-5867d996b6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.237s (2.237s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-361849-99fbd48d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-361849-99fbd48d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-361849: serviceaccount "payload-processing-e2e-shared-b-w2-361849" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-361849

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-361849-99fbd48d5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-361849

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-361849-77978954 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-361849-77978954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-361849-77978954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-361849: serviceaccount "payload-processing-e2e-shared-b-w2-361849" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-361849-99fbd48d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-361849-77978954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

ProbeError

Readiness probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Unhealthy

Readiness probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-cc98e0-5c78dc6db6-lsh5h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-cc98e0-56597c87f7-q2njr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w3-cc98e0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w3-cc98e0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w3-cc98e0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 452c551f-9588-488e-9a32-129cdb48bbb3, UID in object meta:

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w3-cc98e0-openshift-default-656b649fd6-wrk92

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-mt-2a1db100-75b7486f57-k5xgf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2a1db100-5867d996b6-kq5s6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-2a1db100-openshift-default-84dc975848-sw7dz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8be734-777dc4db98-h6c5d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8be734-776b56bf6f-x6zdt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w0-8be734-openshift-default-77769678-ppnbx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd

SuccessfulCreate

Created pod: e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

openshift-ingress

deployment-controller

e2e-api-a-1cf28c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-1cf28c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1cf28c

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.346s (3.346s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1cf28c-6bdf8997

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1cf28c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1cf28c-6bdf8997 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1cf28c: serviceaccount "payload-processing-e2e-api-a-1cf28c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1cf28c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1cf28c-6bdf8997

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1cf28c-6bdf8997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1cf28c: serviceaccount "payload-processing-e2e-api-a-1cf28c" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-6f3c6f-openshift-default-56584f67c8

SuccessfulCreate

Created pod: e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

openshift-ingress

deployment-controller

e2e-api-b-6f3c6f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-6f3c6f-openshift-default-56584f67c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-6f3c6f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-6f3c6f
(x5)

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

multus

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6f3c6f-5658f94b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-6f3c6f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6f3c6f: serviceaccount "payload-processing-e2e-api-b-6f3c6f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-6f3c6f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-6f3c6f-5658f94b9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-6f3c6f-5658f94b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-6f3c6f-5658f94b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-6f3c6f: serviceaccount "payload-processing-e2e-api-b-6f3c6f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-1cf28c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-1cf28c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-1cf28c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-1cf28c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 61242ea7-24c3-41a2-96b2-ee29a06981d5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-1cf28c-6bdf8997-zbcvt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1cf28c-86b8bf6db-f8gxz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-1cf28c-openshift-default-6d4c6fc7cd-4b58n

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-6f3c6f-7467bc7dc4-fk5s9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-6f3c6f-5658f94b9-vhwh8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-6f3c6f-openshift-default-56584f67c8-bdqp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-474b22-68f48b46df-whdk6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-474b22-6cc78d5fc4-77lt9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w1-474b22-openshift-default-c79bf6646-c8mqk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-725559-8689b64ff5-js977

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w1-725559

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w1-725559": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w1-725559, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8f1d8320-4b2d-4180-85dd-9473f3dec2d7, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-725559-855ffff598-bdbmz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w1-725559-openshift-default-546b55fdfb-9xwqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-647268-openshift-default-68988998dd

SuccessfulCreate

Created pod: e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

openshift-ingress

deployment-controller

e2e-ipp-a-647268-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-647268-openshift-default-68988998dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-647268

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-647268

openshift-ingress

multus

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-647268-5b665fc9f9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-647268-5b665fc9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-647268: serviceaccount "payload-processing-e2e-ipp-a-647268" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-647268-5b665fc9f9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-647268

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-647268-5b665fc9f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-647268

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-647268-54c7b8d958 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-647268: serviceaccount "payload-processing-e2e-ipp-a-647268" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-29e19c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-29e19c-openshift-default-5c86bb444b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-29e19c-openshift-default-5c86bb444b

SuccessfulCreate

Created pod: e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-29e19c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-29e19c

openshift-ingress

multus

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-29e19c: serviceaccount "payload-processing-e2e-ipp-b-29e19c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-29e19c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-29e19c: serviceaccount "payload-processing-e2e-ipp-b-29e19c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-29e19c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-29e19c-64cc5fbc57 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-cb9976-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-cb9976

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-cb9976

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

openshift-ingress

multus

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-cb9976

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-cb9976

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cb9976: serviceaccount "payload-processing-e2e-ipp-cleanup-cb9976" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-cb9976: serviceaccount "payload-processing-e2e-ipp-cleanup-cb9976" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-cb9976-ffbfd97d6-dlw4p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-cb9976-5bbbff5547-9g2v7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-cb9976-openshift-default-d76b45b7b-wsxs9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-647268-5b665fc9f9-blrms

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-647268-54c7b8d958-69b69

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-647268-openshift-default-68988998dd-s9jn9

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-29e19c-55cb5c479d-5rz4b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-29e19c-64cc5fbc57-pfc8b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-29e19c-openshift-default-5c86bb444b-wqgsd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fcd402-7755db5695-jxglj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fcd402-67456fbb98-2cmx2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-fcd402-openshift-default-75c6ccfdbd-dnsps

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-361849-99fbd48d5-j6hlj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-361849-77978954-7wqv6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-361849-openshift-default-69cfffbbc8-52ccb

Killing

Stopping container istio-proxy
(x21)

openshift-ingress

kubelet

payload-processing-85fd65c94c-wh5fn

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-qfwsb); attempting to pull the image may not succeed.
(x21)

openshift-ingress

kubelet

payload-pre-processing-76f657cdc4-p72fm

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-qfwsb); attempting to pull the image may not succeed.