Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-49af4f-57676557b5-frkkl to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a7428d13-openshift-default-bc64df448-74rcl to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-75cn5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-75cn5 to ip-10-0-142-208.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-h7l4s to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-588081-openshift-default-648bd9598-kmp66 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6 to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6 to ip-10-0-129-128.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2 to ip-10-0-143-252.ec2.internal

openshift-ingress

kube-auth-proxy-84fbbb6876-9dwpv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84fbbb6876-9dwpv to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-s75vh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-s75vh to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd to ip-10-0-129-128.ec2.internal

openshift-ingress

kube-auth-proxy-84fbbb6876-94b2x

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-84fbbb6876-94b2x to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477 to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49 to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf to ip-10-0-129-128.ec2.internal

openshift-ingress

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8 to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9 to ip-10-0-142-208.ec2.internal

openshift-ingress

router-default-54d767fc5d-pv29k

Scheduled

Successfully assigned openshift-ingress/router-default-54d767fc5d-pv29k to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6 to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5 to ip-10-0-142-208.ec2.internal

openshift-ingress

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs to ip-10-0-142-208.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-7vh9j

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7vh9j to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw to ip-10-0-142-208.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-ss2lh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-ss2lh to ip-10-0-129-128.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj to ip-10-0-143-252.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-588081-59665c9769-gn8pm to ip-10-0-142-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2 to ip-10-0-143-252.ec2.internal

openshift-ingress

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv to ip-10-0-129-128.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-54d767fc5d from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-54d767fc5d

FailedCreate

Error creating: pods "router-default-54d767fc5d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-54d767fc5d

FailedCreate

Error creating: pods "router-default-54d767fc5d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-54d767fc5d

SuccessfulCreate

Created pod: router-default-54d767fc5d-pv29k
(x6)

openshift-ingress

kubelet

router-default-54d767fc5d-pv29k

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-54d767fc5d-pv29k

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-54d767fc5d-pv29k

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-54d767fc5d-pv29k

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-54d767fc5d-pv29k

Created

Created container: router

openshift-ingress

kubelet

router-default-54d767fc5d-pv29k

Started

Started container router

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-9dwpv

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-84fbbb6876 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-84fbbb6876

SuccessfulCreate

Created pod: kube-auth-proxy-84fbbb6876-9dwpv

openshift-ingress

replicaset-controller

kube-auth-proxy-84fbbb6876

SuccessfulCreate

Created pod: kube-auth-proxy-84fbbb6876-94b2x

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-94b2x

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-84fbbb6876

FailedCreate

Error creating: pods "kube-auth-proxy-84fbbb6876-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-84fbbb6876-94b2x

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-94b2x

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-84fbbb6876-9dwpv

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-9dwpv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-7vh9j

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-7vh9j

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-94b2x

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-9dwpv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-9dwpv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-94b2x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.664s (2.664s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-94b2x

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-84fbbb6876-9dwpv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.615s (2.615s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.436s (3.436s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8gdm2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.707s (2.707s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-ss2lh

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ss2lh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-ss2lh

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ss2lh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.296s (2.296s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ss2lh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-ss2lh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-7vh9j

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

ProbeError

Readiness probe error: Get "http://10.134.0.26:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7vh9j

Unhealthy

Readiness probe failed: Get "http://10.134.0.26:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-h7l4s

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-75cn5

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-s75vh
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-s75vh

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-75cn5

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-75cn5

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s75vh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-75cn5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-75cn5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.75s (1.75s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-75cn5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s75vh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s75vh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-s75vh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.6s (1.6s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-h7l4s

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-588081

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-588081

openshift-ingress

deployment-controller

e2e-inf-a-588081-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-588081-openshift-default-648bd9598 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-588081-openshift-default-648bd9598

SuccessfulCreate

Created pod: e2e-inf-a-588081-openshift-default-648bd9598-kmp66

openshift-ingress

multus

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-588081

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-588081-59665c9769 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-588081

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-588081-6585db478b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-588081-6585db478b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-588081-6585db478b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-588081-6585db478b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-588081: serviceaccount "payload-processing-e2e-inf-a-588081" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-588081-59665c9769

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-588081-59665c9769-gn8pm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-588081-59665c9769

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-588081-59665c9769-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-588081: serviceaccount "payload-processing-e2e-inf-a-588081" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-b4496e2f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b4496e2f

openshift-ingress

deployment-controller

e2e-ait-b4496e2f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b4496e2f-openshift-default-6f7f575cb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b4496e2f-openshift-default-6f7f575cb4

SuccessfulCreate

Created pod: e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

openshift-ingress

multus

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-1fd18b-openshift-default-64c6b944b

SuccessfulCreate

Created pod: e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

openshift-ingress

gateway_labeler_controller

e2e-autores-1fd18b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1fd18b

openshift-ingress

deployment-controller

e2e-autores-1fd18b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1fd18b-openshift-default-64c6b944b from 0 to 1

openshift-ingress

multus

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

openshift-ingress

multus

payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b4496e2f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b4496e2f-78c648df5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b4496e2f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b4496e2f-78c648df5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b4496e2f-78c648df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b4496e2f: serviceaccount "payload-processing-e2e-ait-b4496e2f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b4496e2f: serviceaccount "payload-processing-e2e-ait-b4496e2f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b4496e2f-78c648df5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1fd18b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1fd18b-7fc6f8c64f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1fd18b-7fc6f8c64f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1fd18b-7fc6f8c64f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1fd18b-7fc6f8c64f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1fd18b: serviceaccount "payload-processing-e2e-autores-1fd18b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1fd18b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1fd18b-7fcbf946db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1fd18b: serviceaccount "payload-processing-e2e-autores-1fd18b" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd

SuccessfulCreate

Created pod: e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

openshift-ingress

deployment-controller

e2e-inf-b-1dc7b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-1dc7b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-1dc7b1

openshift-ingress

multus

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.469s (2.469s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-1dc7b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-1dc7b1-7b995595 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-1dc7b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1dc7b1-7b995595

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-1dc7b1-7b995595-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1dc7b1: serviceaccount "payload-processing-e2e-inf-b-1dc7b1" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1dc7b1: serviceaccount "payload-processing-e2e-inf-b-1dc7b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1dc7b1-7b995595

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw
(x5)

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-b4496e2f-78c648df5-8mjdd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b4496e2f-54c4f7c57d-2xnpl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-b4496e2f-openshift-default-6f7f575cb4-v7jj6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd

SuccessfulCreate

Created pod: e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

openshift-ingress

deployment-controller

e2e-migrate-e1fbf0a6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-e1fbf0a6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e1fbf0a6-gw

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.302s (2.302s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e1fbf0a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e1fbf0a6: serviceaccount "payload-processing-e2e-migrate-e1fbf0a6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e1fbf0a6: serviceaccount "payload-processing-e2e-migrate-e1fbf0a6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e1fbf0a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

Started

Started container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": read tcp 10.132.0.2:60976->10.132.0.45:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": read tcp 10.132.0.2:60976->10.132.0.45:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-e1fbf0a6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-e1fbf0a6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-e1fbf0a6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-e1fbf0a6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 296c3376-543c-4465-bc83-094709501573, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1fbf0a6-6fcf5589d-65lzr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1fbf0a6-68bd8656db-449vv

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-a7428d13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a7428d13-openshift-default-bc64df448 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-a7428d13-openshift-default-bc64df448

SuccessfulCreate

Created pod: e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

openshift-ingress

gateway_labeler_controller

e2e-ait-a7428d13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a7428d13

openshift-ingress

multus

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a7428d13-c87b57746

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-e1fbf0a6-gw-openshift-default-78fc4f4cbd-pvtvc

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a7428d13-c87b57746

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a7428d13-c87b57746-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a7428d13: serviceaccount "payload-processing-e2e-ait-a7428d13" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a7428d13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a7428d13-5664958bb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a7428d13-5664958bb7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a7428d13-5664958bb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a7428d13: serviceaccount "payload-processing-e2e-ait-a7428d13" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a7428d13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a7428d13-c87b57746 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a7428d13-5664958bb7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

openshift-ingress

multus

payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Unhealthy

Readiness probe failed: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

ProbeError

Readiness probe error: Get "http://10.133.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a7428d13-5664958bb7-sxwsm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a7428d13-c87b57746-wnttn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-a7428d13-openshift-default-bc64df448-74rcl

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-c06406ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c06406ce

openshift-ingress

replicaset-controller

e2e-derive-c06406ce-openshift-default-79864468f6

SuccessfulCreate

Created pod: e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

openshift-ingress

deployment-controller

e2e-derive-c06406ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c06406ce-openshift-default-79864468f6 from 0 to 1

openshift-ingress

multus

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c06406ce-79dd8b9db5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c06406ce-79dd8b9db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c06406ce: serviceaccount "payload-processing-e2e-derive-c06406ce" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c06406ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c06406ce-79dd8b9db5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c06406ce: serviceaccount "payload-processing-e2e-derive-c06406ce" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c06406ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c06406ce-5dcc695c46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c06406ce-79dd8b9db5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

openshift-ingress

kubelet

payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1fd18b-7fc6f8c64f-rhvtb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1fd18b-7fcbf946db-jbzw2

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c06406ce-5dcc695c46-wjhv9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c06406ce-79dd8b9db5-7knrt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-c06406ce-openshift-default-79864468f6-2f2rf

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-49af4f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-49af4f

openshift-ingress

deployment-controller

e2e-explicit-49af4f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-49af4f-openshift-default-78f666f4d8 from 0 to 1

openshift-ingress

kubelet

e2e-autores-1fd18b-openshift-default-64c6b944b-gsvcs

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-49af4f-openshift-default-78f666f4d8

SuccessfulCreate

Created pod: e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

openshift-ingress

multus

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-49af4f-76787666cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-49af4f-57676557b5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-49af4f-57676557b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-49af4f: serviceaccount "payload-processing-e2e-explicit-49af4f" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-49af4f-76787666cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-49af4f-76787666cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-49af4f: serviceaccount "payload-processing-e2e-explicit-49af4f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-49af4f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-49af4f-76787666cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-49af4f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-49af4f-57676557b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-49af4f-57676557b5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

openshift-ingress

kubelet

payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-49af4f-57676557b5-frkkl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-49af4f-76787666cd-fj4pm

Unhealthy

Readiness probe failed: dial tcp 10.132.0.51:9004: connect: connection refused

openshift-ingress

kubelet

e2e-explicit-49af4f-openshift-default-78f666f4d8-snfss

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-0741a0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-0741a0

openshift-ingress

multus

e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-0741a0-openshift-default-6954f9fb58

SuccessfulCreate

Created pod: e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

openshift-ingress

kubelet

e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-0741a0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-0741a0-openshift-default-6954f9fb58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

Unhealthy

Readiness probe failed: dial tcp 10.134.0.52:9004: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-588081

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-588081: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-588081": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-588081, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 68dafcaa-a90b-40d2-946e-3a6a68bdd5fa, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-588081-6585db478b-r4vjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-588081-59665c9769-gn8pm

Unhealthy

Readiness probe failed: dial tcp 10.134.0.53:9004: i/o timeout

openshift-ingress

kubelet

e2e-inf-a-588081-openshift-default-648bd9598-kmp66

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-fedc2772-openshift-default-6478bbcc56

SuccessfulCreate

Created pod: e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

openshift-ingress

deployment-controller

e2e-mt-fedc2772-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fedc2772-openshift-default-6478bbcc56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fedc2772

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fedc2772

openshift-ingress

multus

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fedc2772-64d9885697

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fedc2772

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fedc2772-8cf787c5d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fedc2772: serviceaccount "payload-processing-e2e-mt-fedc2772" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fedc2772-64d9885697

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fedc2772-64d9885697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fedc2772: serviceaccount "payload-processing-e2e-mt-fedc2772" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fedc2772

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fedc2772-64d9885697 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1dc7b1-7b995595-cwqkw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1dc7b1-77698b8fb6-kq5s9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-1dc7b1-openshift-default-7d5dfcf8dd-6kq5t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-4d1885

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-4d1885

openshift-ingress

multus

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6

SuccessfulCreate

Created pod: e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

openshift-ingress

deployment-controller

e2e-shared-a-w3-4d1885-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6 from 0 to 1

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-4d1885: serviceaccount "payload-processing-e2e-shared-a-w3-4d1885" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-4d1885

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-4d1885: serviceaccount "payload-processing-e2e-shared-a-w3-4d1885" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-4d1885

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Unhealthy

Readiness probe failed: Get "http://10.134.0.79:15021/healthz/ready": read tcp 10.134.0.2:60416->10.134.0.79:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

ProbeError

Readiness probe error: Get "http://10.134.0.79:15021/healthz/ready": read tcp 10.134.0.2:60416->10.134.0.79:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4

SuccessfulCreate

Created pod: e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-0cc31a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-0cc31a

openshift-ingress

deployment-controller

e2e-shared-b-w3-0cc31a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fedc2772-64d9885697-l8jvs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fedc2772-8cf787c5d-qjqdk

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-0cc31a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0cc31a: serviceaccount "payload-processing-e2e-shared-b-w3-0cc31a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-0cc31a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-0cc31a: serviceaccount "payload-processing-e2e-shared-b-w3-0cc31a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-fedc2772-openshift-default-6478bbcc56-6w477

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-0741a0-openshift-default-6954f9fb58-ljgjh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-1436b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-1436b9

openshift-ingress

replicaset-controller

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48

SuccessfulCreate

Created pod: e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

openshift-ingress

deployment-controller

e2e-shared-a-w2-1436b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1436b9: serviceaccount "payload-processing-e2e-shared-a-w2-1436b9" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-1436b9: serviceaccount "payload-processing-e2e-shared-a-w2-1436b9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-1436b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-1436b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-ca4fba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-ca4fba

openshift-ingress

deployment-controller

e2e-shared-b-w2-ca4fba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd

SuccessfulCreate

Created pod: e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ca4fba: serviceaccount "payload-processing-e2e-shared-b-w2-ca4fba" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ca4fba: serviceaccount "payload-processing-e2e-shared-b-w2-ca4fba" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-ca4fba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-ca4fba-58df46f549 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-ca4fba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

multus

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-ada83762-openshift-default-fb85f5dbd

SuccessfulCreate

Created pod: e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

openshift-ingress

gateway_labeler_controller

e2e-mt-ada83762

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ada83762

openshift-ingress

deployment-controller

e2e-mt-ada83762-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ada83762-openshift-default-fb85f5dbd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ada83762-6568f69f45

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ada83762-6568f69f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ada83762: serviceaccount "payload-processing-e2e-mt-ada83762" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ada83762

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ada83762-6568f69f45 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ada83762

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ada83762-76bd5cb586 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ada83762-76bd5cb586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ada83762-76bd5cb586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ada83762-76bd5cb586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ada83762: serviceaccount "payload-processing-e2e-mt-ada83762" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ada83762-6568f69f45

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-ada83762-6568f69f45-j8fb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ada83762-76bd5cb586-t4hgg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-ada83762-openshift-default-fb85f5dbd-kn8v6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-1aa465

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1aa465

openshift-ingress

multus

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-api-a-1aa465-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1aa465-openshift-default-798f8fb744 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-1aa465-openshift-default-798f8fb744

SuccessfulCreate

Created pod: e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1aa465

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1aa465-5b7cdd794c from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1aa465-664646c578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1aa465-664646c578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1aa465: serviceaccount "payload-processing-e2e-api-a-1aa465" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1aa465-5b7cdd794c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1aa465-5b7cdd794c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1aa465: serviceaccount "payload-processing-e2e-api-a-1aa465" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1aa465

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1aa465-664646c578 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1aa465-5b7cdd794c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1aa465-664646c578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

openshift-ingress

kubelet

payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-dbbedd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-dbbedd

openshift-ingress

deployment-controller

e2e-api-b-dbbedd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-dbbedd-openshift-default-8559b65d48 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-api-b-dbbedd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-b-dbbedd-authn-ssl: envoyfilters.networking.istio.io "e2e-api-b-dbbedd-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-api-b-dbbedd-openshift-default-8559b65d48

SuccessfulCreate

Created pod: e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

openshift-ingress

multus

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

AddedInterface

Add eth0 [10.134.0.97/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-dbbedd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-dbbedd-76c9cbb5f9 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-dbbedd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-dbbedd-748899d8f4 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dbbedd: serviceaccount "payload-processing-e2e-api-b-dbbedd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dbbedd: serviceaccount "payload-processing-e2e-api-b-dbbedd" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

AddedInterface

Add eth0 [10.134.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

ProbeError

Startup probe error: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Unhealthy

Startup probe failed: Get "http://10.134.0.97:15021/healthz/ready": dial tcp 10.134.0.97:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-1aa465-5b7cdd794c-xn2d6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-1aa465

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-1aa465: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-1aa465": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-1aa465, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c309c1f2-4aa2-4c88-8cdb-8fe516cca497, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1aa465-664646c578-v7jw5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-1aa465-openshift-default-798f8fb744-hmw49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-dbbedd-76c9cbb5f9-69nbf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dbbedd-748899d8f4-cvzxj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-dbbedd-openshift-default-8559b65d48-c42t5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd

SuccessfulCreate

Created pod: e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d0f6b5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d0f6b5

openshift-ingress

deployment-controller

e2e-ipp-a-d0f6b5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd from 0 to 1

openshift-ingress

multus

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d0f6b5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d0f6b5: serviceaccount "payload-processing-e2e-ipp-a-d0f6b5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d0f6b5: serviceaccount "payload-processing-e2e-ipp-a-d0f6b5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d0f6b5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-1436b9-5765f47bc4-gq6fj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-1436b9-5bbcdb4cbc-wrlh8

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd

AddedInterface

Add eth0 [10.134.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

AddedInterface

Add eth0 [10.134.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-1436b9-openshift-default-86f5d54b48-vqbfd

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ca4fba-58df46f549-xc9cl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ca4fba-d77d959c8-lqks4

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6693ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6693ae

openshift-ingress

deployment-controller

e2e-ipp-b-6693ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6693ae-openshift-default-74b5d4c7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b

SuccessfulCreate

Created pod: e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

openshift-ingress

multus

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-ca4fba-openshift-default-7dbd8b77fd-82sdd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6693ae-6f54775b67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6693ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6693ae-6f54775b67 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6693ae: serviceaccount "payload-processing-e2e-ipp-b-6693ae" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6693ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6693ae-7cff786886 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6693ae-6f54775b67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6693ae-6f54775b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6693ae: serviceaccount "payload-processing-e2e-ipp-b-6693ae" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

AddedInterface

Add eth0 [10.134.0.107/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

AddedInterface

Add eth0 [10.134.0.106/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

openshift-ingress

deployment-controller

e2e-ipp-cleanup-14a23e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-14a23e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-14a23e

openshift-ingress

multus

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-14a23e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-14a23e: serviceaccount "payload-processing-e2e-ipp-cleanup-14a23e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-14a23e: serviceaccount "payload-processing-e2e-ipp-cleanup-14a23e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-14a23e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": read tcp 10.133.0.2:38016->10.133.0.61:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": read tcp 10.133.0.2:38016->10.133.0.61:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-14a23e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14a23e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-14a23e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14a23e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 06622f91-9182-4e2f-b717-d393864a722a, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14a23e-5687d45d9f-m55vf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14a23e-554dcb8fc8-nwbbz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-14a23e-openshift-default-575ddd45dd-g7zph

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d0f6b5-5cb79b5679-kw2bz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d0f6b5-f8cbf4fc4-7r2rd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d0f6b5-openshift-default-6887c4c5dd-4tgpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6693ae-7cff786886-b7cl5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6693ae-6f54775b67-jrsnz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6693ae-openshift-default-74b5d4c7b-p229b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-4d1885-54769bb8dc-kcsnl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-4d1885-6f6c55f958-zwdrf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-4d1885-openshift-default-6c8957b9f6-6fbcn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-0cc31a-6645d58c8c-b4j6k

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-0cc31a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0cc31a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-0cc31a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-0cc31a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f836620-ec11-4862-a96c-9d3887e03e19, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-0cc31a-7dd86d58-kx8wz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-0cc31a-openshift-default-5fb54df9d4-8v9rv

Killing

Stopping container istio-proxy