Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4 to ip-10-0-138-139.ec2.internal

openshift-ingress

kube-auth-proxy-7d9b555765-f2852

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d9b555765-f2852 to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p to ip-10-0-138-150.ec2.internal

openshift-ingress

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-8972e2-687979c689-7w7sb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp to ip-10-0-138-150.ec2.internal

openshift-ingress

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6 to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp to ip-10-0-138-150.ec2.internal

openshift-ingress

e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

Scheduled

Successfully assigned openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8 to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9 to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8 to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4 to ip-10-0-138-150.ec2.internal

openshift-ingress

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp to ip-10-0-137-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc to ip-10-0-138-150.ec2.internal

openshift-ingress

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f to ip-10-0-138-139.ec2.internal

openshift-ingress

kube-auth-proxy-7d9b555765-hzxqd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d9b555765-hzxqd to ip-10-0-137-120.ec2.internal

openshift-ingress

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 to ip-10-0-138-139.ec2.internal

openshift-ingress

router-default-5dbbc657dd-v7w6k

Scheduled

Successfully assigned openshift-ingress/router-default-5dbbc657dd-v7w6k to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5 to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g to ip-10-0-138-139.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-g9w2m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-g9w2m to ip-10-0-138-150.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z to ip-10-0-137-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx to ip-10-0-138-150.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-jv9xt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-jv9xt to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87 to ip-10-0-138-150.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6 to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-pdlcg

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-pdlcg to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk to ip-10-0-137-120.ec2.internal

openshift-ingress

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Scheduled

Successfully assigned openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7 to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd to ip-10-0-138-150.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp to ip-10-0-138-139.ec2.internal

openshift-ingress

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq to ip-10-0-138-139.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-qxh2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-qxh2c to ip-10-0-138-150.ec2.internal

openshift-ingress

e2e-shared-b-w2-063e1d-openshift-default

ClusterIPNotAllocated

Cluster IP [IPv4]: 172.31.160.131 is not allocated; repairing

openshift-ingress

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 to ip-10-0-138-139.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5dbbc657dd from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-5dbbc657dd

FailedCreate

Error creating: pods "router-default-5dbbc657dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5dbbc657dd

FailedCreate

Error creating: pods "router-default-5dbbc657dd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5dbbc657dd

SuccessfulCreate

Created pod: router-default-5dbbc657dd-v7w6k
(x5)

openshift-ingress

kubelet

router-default-5dbbc657dd-v7w6k

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5dbbc657dd-v7w6k

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5dbbc657dd-v7w6k

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5dbbc657dd-v7w6k

Started

Started container router

openshift-ingress

kubelet

router-default-5dbbc657dd-v7w6k

Created

Created container: router

openshift-ingress

kubelet

router-default-5dbbc657dd-v7w6k

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-7d9b555765

SuccessfulCreate

Created pod: kube-auth-proxy-7d9b555765-f2852

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-f2852

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d9b555765

FailedCreate

Error creating: pods "kube-auth-proxy-7d9b555765-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7d9b555765

SuccessfulCreate

Created pod: kube-auth-proxy-7d9b555765-hzxqd

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d9b555765 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-hzxqd

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-hzxqd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-g9w2m

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-7d9b555765-hzxqd

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-f2852

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d9b555765-f2852

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-g9w2m

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g9w2m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-hzxqd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-f2852

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-hzxqd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-hzxqd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.791s (2.791s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-f2852

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d9b555765-f2852

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.75s (2.75s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g9w2m

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g9w2m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.892s (3.892s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g9w2m

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-jv9xt

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jv9xt

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jv9xt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-jv9xt

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-jv9xt

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.913s (4.913s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-g9w2m

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-g9w2m

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9ks5r

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qxh2c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-pdlcg
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-qxh2c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-qxh2c

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-processing-5b54b7fbb7-pdlcg

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pdlcg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pdlcg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.789s (1.789s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qxh2c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.622s (1.622s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pdlcg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-pdlcg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qxh2c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-qxh2c

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9ks5r

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-28dbae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-28dbae

openshift-ingress

deployment-controller

e2e-inf-a-28dbae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-28dbae-openshift-default-6659c6d5bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-28dbae-openshift-default-6659c6d5bb

SuccessfulCreate

Created pod: e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

openshift-ingress

multus

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-28dbae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-28dbae: serviceaccount "payload-processing-e2e-inf-a-28dbae" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-28dbae: serviceaccount "payload-processing-e2e-inf-a-28dbae" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-28dbae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-28dbae-5b6d54b6f7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-e7db0e72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e7db0e72

openshift-ingress

deployment-controller

e2e-ait-e7db0e72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e7db0e72-openshift-default-79967ffdc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-e7db0e72-openshift-default-79967ffdc6

SuccessfulCreate

Created pod: e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

openshift-ingress

multus

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e7db0e72-68d6c7498c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e7db0e72-68d6c7498c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e7db0e72: serviceaccount "payload-processing-e2e-ait-e7db0e72" not found

openshift-ingress

gateway_labeler_controller

e2e-autores-3a438f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-3a438f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e7db0e72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e7db0e72: serviceaccount "payload-processing-e2e-ait-e7db0e72" not found

openshift-ingress

GatewayAuthBootstrap

e2e-autores-3a438f

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-autores-3a438f-authn-ssl: envoyfilters.networking.istio.io "e2e-autores-3a438f-authn-ssl" already exists

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e7db0e72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e7db0e72-68d6c7498c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e7db0e72-68d6c7498c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

openshift-ingress

deployment-controller

e2e-autores-3a438f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-3a438f-openshift-default-7bc5cb9f7b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

openshift-ingress

replicaset-controller

e2e-autores-3a438f-openshift-default-7bc5cb9f7b

SuccessfulCreate

Created pod: e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3a438f-64cd976f66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3a438f-64cd976f66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-3a438f-64cd976f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3a438f: serviceaccount "payload-processing-e2e-autores-3a438f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-3a438f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-3a438f-64cd976f66 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3a438f-74ff884cb7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-3a438f-74ff884cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3a438f: serviceaccount "payload-processing-e2e-autores-3a438f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-3a438f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-3a438f-74ff884cb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3a438f-74ff884cb7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

openshift-ingress

kubelet

payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Started

Started container istio-proxy

openshift-ingress

multus

payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-1f1f85

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-1f1f85

openshift-ingress

multus

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-inf-b-1f1f85-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-1f1f85-openshift-default-86c6c49954 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-1f1f85-openshift-default-86c6c49954

SuccessfulCreate

Created pod: e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1f1f85-685664577c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-1f1f85-685664577c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1f1f85: serviceaccount "payload-processing-e2e-inf-b-1f1f85" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-1f1f85

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-1f1f85-685664577c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-1f1f85

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-1f1f85: serviceaccount "payload-processing-e2e-inf-b-1f1f85" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-1f1f85-685664577c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp
(x5)

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-e7db0e72

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-e7db0e72: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-e7db0e72": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-e7db0e72, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c03becec-93c4-4076-a1b1-ab8fbe2c1c4c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e7db0e72-fcf7b8ccd-pmsk4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776

SuccessfulCreate

Created pod: e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

openshift-ingress

gateway_labeler_controller

e2e-migrate-4a0c9f43-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-4a0c9f43-gw

openshift-ingress

deployment-controller

e2e-migrate-4a0c9f43-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776 from 0 to 1

openshift-ingress

multus

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

openshift-ingress

multus

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-4a0c9f43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4a0c9f43: serviceaccount "payload-processing-e2e-migrate-4a0c9f43" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-4a0c9f43: serviceaccount "payload-processing-e2e-migrate-4a0c9f43" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-4a0c9f43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:37650->10.134.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:37650->10.134.0.53:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-4a0c9f43-64b76957fd-dww6q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-4a0c9f43

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-4a0c9f43: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-4a0c9f43": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-4a0c9f43, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 96e3ccef-72d8-496d-8827-bacef691219f, UID in object meta:

openshift-ingress

deployment-controller

e2e-ait-00575c78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-00575c78-openshift-default-99dbcdcd from 0 to 1

openshift-ingress

multus

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-00575c78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-00575c78

openshift-ingress

replicaset-controller

e2e-ait-00575c78-openshift-default-99dbcdcd

SuccessfulCreate

Created pod: e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-00575c78-598c4b5486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-00575c78-55899cc5b5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-00575c78-55899cc5b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-00575c78: serviceaccount "payload-processing-e2e-ait-00575c78" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-00575c78-598c4b5486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-00575c78-598c4b5486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-00575c78: serviceaccount "payload-processing-e2e-ait-00575c78" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-00575c78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-00575c78-598c4b5486 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-00575c78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-00575c78-55899cc5b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-00575c78-55899cc5b5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-00575c78-598c4b5486-4wwqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-00575c78-55899cc5b5-whxng

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-e5ec8ad4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e5ec8ad4

openshift-ingress

replicaset-controller

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8

SuccessfulCreate

Created pod: e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

openshift-ingress

deployment-controller

e2e-derive-e5ec8ad4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8 from 0 to 1

openshift-ingress

kubelet

e2e-ait-00575c78-openshift-default-99dbcdcd-247dn

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e5ec8ad4-79f5f77657

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e5ec8ad4-79f5f77657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e5ec8ad4: serviceaccount "payload-processing-e2e-derive-e5ec8ad4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e5ec8ad4: serviceaccount "payload-processing-e2e-derive-e5ec8ad4" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e5ec8ad4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e5ec8ad4-79f5f77657 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e5ec8ad4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e5ec8ad4-79f5f77657

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

openshift-ingress

multus

payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Unhealthy

Readiness probe failed: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

ProbeError

Readiness probe error: Get "http://10.134.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e5ec8ad4-79f5f77657-q6z9p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3a438f-74ff884cb7-8pnrw

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-explicit-8972e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-8972e2

openshift-ingress

deployment-controller

e2e-explicit-8972e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-8972e2-openshift-default-59c58d7d48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-8972e2-openshift-default-59c58d7d48

SuccessfulCreate

Created pod: e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-8972e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-8972e2-687979c689 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8972e2-687979c689

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-8972e2-687979c689-7w7sb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8972e2: serviceaccount "payload-processing-e2e-explicit-8972e2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-8972e2-687979c689

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-8972e2-687979c689-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-8972e2: serviceaccount "payload-processing-e2e-explicit-8972e2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-8972e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-8972e2-84ddbdb898 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-8972e2-687979c689-7w7sb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8972e2-687979c689-7w7sb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-8972e2-687979c689-7w7sb

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-8972e2-687979c689-7w7sb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-1f90a11e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1f90a11e

openshift-ingress

multus

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-1f90a11e-openshift-default-b8b865dd4

SuccessfulCreate

Created pod: e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

openshift-ingress

deployment-controller

e2e-mt-1f90a11e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1f90a11e-openshift-default-b8b865dd4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1f90a11e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1f90a11e-646f6ddcc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1f90a11e: serviceaccount "payload-processing-e2e-mt-1f90a11e" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1f90a11e-646f6ddcc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1f90a11e-646f6ddcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1f90a11e: serviceaccount "payload-processing-e2e-mt-1f90a11e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1f90a11e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1f90a11e-646f6ddcc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

openshift-ingress

kubelet

payload-processing-e2e-explicit-8972e2-687979c689-7w7sb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-8972e2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-8972e2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-8972e2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-8972e2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 440685ec-465e-4947-8738-4cb2da5fc475, UID in object meta:

openshift-ingress

replicaset-controller

e2e-noten-5ea2db-openshift-default-5bcbdfb758

SuccessfulCreate

Created pod: e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

openshift-ingress

deployment-controller

e2e-noten-5ea2db-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-5ea2db-openshift-default-5bcbdfb758 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-5ea2db

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-5ea2db

openshift-ingress

kubelet

e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

ProbeError

Startup probe error: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

Unhealthy

Startup probe failed: Get "http://10.134.0.66:15021/healthz/ready": dial tcp 10.134.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1f90a11e-646f6ddcc-wb2xd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-94f305-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-94f305-openshift-default-8544587896 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-94f305-openshift-default-8544587896

SuccessfulCreate

Created pod: e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-94f305

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-94f305

openshift-ingress

kubelet

e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-94f305: serviceaccount "payload-processing-e2e-shared-a-w2-94f305" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-94f305: serviceaccount "payload-processing-e2e-shared-a-w2-94f305" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-94f305

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-94f305-6ccc94866c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-94f305

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-28dbae

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-28dbae": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b40377a3-e9bf-43ba-9ae0-625899f0dc42, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Unhealthy

Readiness probe failed: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

ProbeError

Readiness probe error: Get "http://10.134.0.70:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-063e1d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-063e1d

openshift-ingress

multus

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-063e1d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb

SuccessfulCreate

Created pod: e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-1f1f85

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-1f1f85": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b5b6159d-6991-42bb-8be3-f9bc0ae39907, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-1f1f85-685664577c-pv9tp

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-063e1d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d: serviceaccount "payload-processing-e2e-shared-b-w2-063e1d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d: serviceaccount "payload-processing-e2e-shared-b-w2-063e1d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-063e1d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2da572

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2da572

openshift-ingress

deployment-controller

e2e-shared-a-w3-2da572-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2da572-openshift-default-cc847cb78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2da572-openshift-default-cc847cb78

SuccessfulCreate

Created pod: e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

openshift-ingress

multus

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2da572

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2da572

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2da572-89fd55cbf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2da572: serviceaccount "payload-processing-e2e-shared-a-w3-2da572" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2da572: serviceaccount "payload-processing-e2e-shared-a-w3-2da572" not found

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

ProbeError

Readiness probe error: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Unhealthy

Readiness probe failed: Get "http://10.134.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Unhealthy

Startup probe failed: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

ProbeError

Startup probe error: Get "http://10.134.0.77:15021/healthz/ready": dial tcp 10.134.0.77:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4b268f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4b268f

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b

SuccessfulCreate

Created pod: e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

openshift-ingress

deployment-controller

e2e-shared-b-w3-4b268f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-6d5278a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6d5278a1

openshift-ingress

deployment-controller

e2e-mt-6d5278a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6d5278a1-openshift-default-845d57b9b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6d5278a1-openshift-default-845d57b9b4

SuccessfulCreate

Created pod: e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

openshift-ingress

multus

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4b268f: serviceaccount "payload-processing-e2e-shared-b-w3-4b268f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4b268f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4b268f-d9c798f57 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4b268f: serviceaccount "payload-processing-e2e-shared-b-w3-4b268f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4b268f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6d5278a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6d5278a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6d5278a1-778fbd7f6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d5278a1-778fbd7f6f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6d5278a1-778fbd7f6f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6d5278a1-778fbd7f6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d5278a1: serviceaccount "payload-processing-e2e-mt-6d5278a1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6d5278a1: serviceaccount "payload-processing-e2e-mt-6d5278a1" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

ProbeError

Startup probe error: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Unhealthy

Startup probe failed: Get "http://10.134.0.81:15021/healthz/ready": dial tcp 10.134.0.81:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6d5278a1-75bd944fdb-ktlnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-5052bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5052bd-openshift-default-5f96c7cbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-5052bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5052bd

openshift-ingress

replicaset-controller

e2e-api-a-5052bd-openshift-default-5f96c7cbd

SuccessfulCreate

Created pod: e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

openshift-ingress

GatewayAuthBootstrap

e2e-api-a-5052bd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-a-5052bd-authn-ssl: envoyfilters.networking.istio.io "e2e-api-a-5052bd-authn-ssl" already exists

openshift-ingress

multus

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5052bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5052bd-57546cb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5052bd-57546cb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5052bd-57546cb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5052bd: serviceaccount "payload-processing-e2e-api-a-5052bd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5052bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5052bd: serviceaccount "payload-processing-e2e-api-a-5052bd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5052bd-57546cb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

openshift-ingress

kubelet

payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

ProbeError

Startup probe error: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-44c67e-openshift-default-58c799c87b

SuccessfulCreate

Created pod: e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z
(x6)

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Unhealthy

Startup probe failed: Get "http://10.134.0.84:15021/healthz/ready": dial tcp 10.134.0.84:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-api-b-44c67e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-44c67e-openshift-default-58c799c87b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-44c67e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-44c67e

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.888s (2.888s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-44c67e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-44c67e-674fd556bc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-44c67e-674fd556bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-44c67e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-44c67e: serviceaccount "payload-processing-e2e-api-b-44c67e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-44c67e-674fd556bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-44c67e-674fd556bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-44c67e: serviceaccount "payload-processing-e2e-api-b-44c67e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-5052bd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-5052bd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-5052bd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-5052bd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 86e09bc5-bdbf-4348-9835-23828408469b, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-5052bd-57546cb7-7st6m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5052bd-5fb697c6fd-hn5jp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-44c67e-9c9d7fbdb-kjwf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-44c67e-openshift-default-58c799c87b-2rj5z

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-94f305

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-94f305": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: eb228346-7008-45ba-a187-2ed1cf59d6d1, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-063e1d-68b55df946-wvw7q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-595479

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-595479

openshift-ingress

deployment-controller

e2e-ipp-a-595479-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-595479-openshift-default-85649bb55b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-595479-openshift-default-85649bb55b

SuccessfulCreate

Created pod: e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

openshift-ingress

multus

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

AddedInterface

Add eth0 [10.134.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-595479

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-595479-57f996b554 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-595479

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-595479-f6545889f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-595479-f6545889f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-595479-f6545889f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-595479: serviceaccount "payload-processing-e2e-ipp-a-595479" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-595479-f6545889f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-595479-57f996b554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-595479-57f996b554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-595479-57f996b554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-595479: serviceaccount "payload-processing-e2e-ipp-a-595479" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": read tcp 10.134.0.2:56030->10.134.0.90:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": read tcp 10.134.0.2:56030->10.134.0.90:15021: read: connection reset by peer body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Unhealthy

Startup probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

ProbeError

Startup probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c6c079

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c6c079

openshift-ingress

deployment-controller

e2e-ipp-b-c6c079-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c6c079-openshift-default-855654c4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c6c079-openshift-default-855654c4d

SuccessfulCreate

Created pod: e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

openshift-ingress

multus

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c6c079: serviceaccount "payload-processing-e2e-ipp-b-c6c079" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c6c079-df865d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c6c079-df865d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c6c079: serviceaccount "payload-processing-e2e-ipp-b-c6c079" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c6c079-df865d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c6c079

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c6c079-df865d78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c6c079

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c6c079-66bfdf57dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-2cdd19

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-2cdd19

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

openshift-ingress

deployment-controller

e2e-ipp-cleanup-2cdd19-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-2cdd19

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-2cdd19

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19: serviceaccount "payload-processing-e2e-ipp-cleanup-2cdd19" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19: serviceaccount "payload-processing-e2e-ipp-cleanup-2cdd19" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

AddedInterface

Add eth0 [10.134.0.96/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-2cdd19-85cccbfc8-bw6l8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-2cdd19-openshift-default-6ff6c577d-ldqdp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-595479-f6545889f-4hndw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

Unhealthy

Readiness probe failed: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7

ProbeError

Readiness probe error: Get "http://10.134.0.90:15021/healthz/ready": dial tcp 10.134.0.90:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9

Unhealthy

Readiness probe failed: dial tcp 10.134.0.93:9004: i/o timeout

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj

Unhealthy

Readiness probe failed: dial tcp 10.134.0.94:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-c6c079-openshift-default-855654c4d-qw6vk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2da572-d9477b454-q9qtn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4b268f-6c4f46685d-pnh87

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4b268f-d9c798f57-55gq5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq

Killing

Stopping container istio-proxy