Time Namespace Component RelatedObject Reason Message

openshift-ingress

router-default-69d68c9d66-2gblx

Scheduled

Successfully assigned openshift-ingress/router-default-69d68c9d66-2gblx to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm to ip-10-0-143-9.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5 to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-bb6qh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-bb6qh to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d to ip-10-0-129-113.ec2.internal

openshift-ingress

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb to ip-10-0-143-9.ec2.internal

openshift-ingress

kube-auth-proxy-5c6796f956-wzrsb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c6796f956-wzrsb to ip-10-0-131-76.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5 to ip-10-0-143-9.ec2.internal

openshift-ingress

kube-auth-proxy-5c6796f956-5wjrr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5c6796f956-5wjrr to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-44f561-6c866756fc-kvlmv to ip-10-0-129-113.ec2.internal

openshift-ingress

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46 to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49 to ip-10-0-129-113.ec2.internal

openshift-ingress

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx to ip-10-0-129-113.ec2.internal

openshift-ingress

router-default-69d68c9d66-2gblx

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744 to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt to ip-10-0-129-113.ec2.internal

openshift-ingress

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6 to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq to ip-10-0-129-113.ec2.internal

openshift-ingress

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64 to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97 to ip-10-0-129-113.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-fsb7x

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-42wkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-42wkt to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-44f561-768b76957d-975fv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-44f561-768b76957d-975fv to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9 to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft to ip-10-0-131-76.ec2.internal

openshift-ingress

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Scheduled

Successfully assigned openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t to ip-10-0-129-113.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-pz99g

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-pz99g to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn to ip-10-0-143-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z to ip-10-0-129-113.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz to ip-10-0-131-76.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Scheduled

Successfully assigned openshift-ingress/e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx to ip-10-0-129-113.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk to ip-10-0-143-9.ec2.internal

openshift-ingress

e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

Scheduled

Successfully assigned openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j to ip-10-0-143-9.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-69d68c9d66 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-69d68c9d66

FailedCreate

Error creating: pods "router-default-69d68c9d66-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-69d68c9d66

FailedCreate

Error creating: pods "router-default-69d68c9d66-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-69d68c9d66

SuccessfulCreate

Created pod: router-default-69d68c9d66-2gblx
(x6)

openshift-ingress

kubelet

router-default-69d68c9d66-2gblx

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-69d68c9d66-2gblx

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-69d68c9d66-2gblx

Created

Created container: router

openshift-ingress

kubelet

router-default-69d68c9d66-2gblx

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-69d68c9d66-2gblx

Started

Started container router

openshift-ingress

multus

router-default-69d68c9d66-2gblx

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes
(x2)

openshift-ingress

replicaset-controller

kube-auth-proxy-5c6796f956

FailedCreate

Error creating: pods "kube-auth-proxy-5c6796f956-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5c6796f956

SuccessfulCreate

Created pod: kube-auth-proxy-5c6796f956-wzrsb

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5c6796f956 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5c6796f956-5wjrr

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-5wjrr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5c6796f956-wzrsb

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5c6796f956

SuccessfulCreate

Created pod: kube-auth-proxy-5c6796f956-5wjrr

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-wzrsb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-pz99g

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-pz99g

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-5wjrr

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-5wjrr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.911s (2.911s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-wzrsb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-wzrsb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-wzrsb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.974s (2.974s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5c6796f956-5wjrr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.749s (2.749s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.06s (3.06s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.96s (2.96s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

Unhealthy

Startup probe failed: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bc85wp5

ProbeError

Startup probe error: Get "http://10.134.0.26:15021/healthz/ready": dial tcp 10.134.0.26:15021: connect: connection refused body:

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-fsb7x

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-fsb7x

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fsb7x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fsb7x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.326s (2.326s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fsb7x

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fsb7x

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fsb7x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fsb7x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

ProbeError

Readiness probe error: Get "http://10.132.0.35:8080/ready": dial tcp 10.132.0.35:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-pz99g

Unhealthy

Readiness probe failed: Get "http://10.132.0.35:8080/ready": dial tcp 10.132.0.35:8080: connect: connection refused

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-pz99g
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-ks4rw

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-bb6qh

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-bb6qh

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bb6qh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-42wkt

openshift-ingress

multus

payload-processing-5b54b7fbb7-42wkt

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-42wkt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bb6qh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.376s (1.376s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-42wkt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.288s (1.288s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-42wkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-42wkt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bb6qh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-bb6qh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

ProbeError

Readiness probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-ks4rw

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c4ce82

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c4ce82

openshift-ingress

deployment-controller

e2e-worker-w0-8e708f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-8e708f-openshift-default-c57f9d54d from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-c4ce82-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c4ce82-openshift-default-8555cd6c9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b

SuccessfulCreate

Created pod: e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

openshift-ingress

replicaset-controller

e2e-worker-w0-8e708f-openshift-default-c57f9d54d

SuccessfulCreate

Created pod: e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

openshift-ingress

replicaset-controller

e2e-worker-w4-b3b22c-openshift-default-86c99798d4

SuccessfulCreate

Created pod: e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-8e708f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-8e708f

openshift-ingress

deployment-controller

e2e-worker-w4-b3b22c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-b3b22c-openshift-default-86c99798d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-b3b22c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-b3b22c

openshift-ingress

multus

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.299s (3.299s including waiting). Image size: 181318953 bytes.
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8e708f-55b689fd47

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-8e708f-55b689fd47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8e708f: serviceaccount "payload-processing-e2e-worker-w0-8e708f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-8e708f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-8e708f-55b689fd47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-8e708f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-8e708f: serviceaccount "payload-processing-e2e-worker-w0-8e708f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-8e708f-55b689fd47

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b3b22c: serviceaccount "payload-processing-e2e-worker-w4-b3b22c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-b3b22c: serviceaccount "payload-processing-e2e-worker-w4-b3b22c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-b3b22c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-b3b22c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.526s (1.526s including waiting). Image size: 166453408 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-a6519132-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a6519132-openshift-default-698b7855dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a6519132

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a6519132

openshift-ingress

replicaset-controller

e2e-ait-a6519132-openshift-default-698b7855dd

SuccessfulCreate

Created pod: e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

openshift-ingress

multus

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c4ce82

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c4ce82-5b766fc955

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c4ce82-5b766fc955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c4ce82: serviceaccount "payload-processing-e2e-inf-a-c4ce82" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c4ce82

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c4ce82-5b766fc955 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c4ce82-5b766fc955

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c4ce82: serviceaccount "payload-processing-e2e-inf-a-c4ce82" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a6519132

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a6519132-5947b7df8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a6519132-5947b7df8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a6519132-5947b7df8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a6519132: serviceaccount "payload-processing-e2e-ait-a6519132" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a6519132

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a6519132-5765c95578 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a6519132-5765c95578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a6519132-5765c95578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a6519132: serviceaccount "payload-processing-e2e-ait-a6519132" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a6519132-5765c95578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-44f561

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-44f561

openshift-ingress

kubelet

payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-44f561-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-44f561-openshift-default-6f6685d5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-44f561-openshift-default-6f6685d5d

SuccessfulCreate

Created pod: e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a6519132-5947b7df8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.894s (2.894s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-44f561-768b76957d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-44f561-768b76957d-975fv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-44f561-768b76957d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-44f561-768b76957d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-44f561: serviceaccount "payload-processing-e2e-autores-44f561" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-44f561-6c866756fc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-44f561-6c866756fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-44f561: serviceaccount "payload-processing-e2e-autores-44f561" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-44f561

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-44f561-768b76957d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-44f561-6c866756fc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

openshift-ingress

deployment-controller

payload-processing-e2e-autores-44f561

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-44f561-6c866756fc from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-b-5a005d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5a005d-openshift-default-cc9788f6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-inf-b-5a005d-openshift-default-cc9788f6b

SuccessfulCreate

Created pod: e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44f561-768b76957d-975fv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44f561-768b76957d-975fv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5a005d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5a005d

openshift-ingress

multus

payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-44f561-768b76957d-975fv

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44f561-768b76957d-975fv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

Started

Started container istio-proxy

openshift-ingress

multus

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

ProbeError

Startup probe error: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

Unhealthy

Startup probe failed: Get "http://10.134.0.37:15021/healthz/ready": dial tcp 10.134.0.37:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm
(x6)

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5a005d: serviceaccount "payload-processing-e2e-inf-b-5a005d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5a005d-756b74fb85

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5a005d-756b74fb85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5a005d: serviceaccount "payload-processing-e2e-inf-b-5a005d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5a005d-756b74fb85

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5a005d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5a005d-756b74fb85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5a005d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a6519132-5947b7df8c-jfx49

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a6519132-5765c95578-nmxz8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8

SuccessfulCreate

Created pod: e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

openshift-ingress

deployment-controller

e2e-migrate-f7939b7a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-f7939b7a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f7939b7a-gw

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Started

Started container istio-proxy

openshift-ingress

multus

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f7939b7a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f7939b7a-58fd768898 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f7939b7a-58fd768898

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f7939b7a-58fd768898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f7939b7a: serviceaccount "payload-processing-e2e-migrate-f7939b7a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f7939b7a-58fd768898

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f7939b7a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f7939b7a-fffd54866 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f7939b7a: serviceaccount "payload-processing-e2e-migrate-f7939b7a" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f7939b7a-fffd54866-xlsbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f7939b7a-58fd768898-cplfg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4

SuccessfulCreate

Created pod: e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

openshift-ingress

deployment-controller

e2e-ait-f8c7c101-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f8c7c101-openshift-default-7fb9fd8df4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-f8c7c101

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f8c7c101
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f8c7c101-9d765647c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f8c7c101-9d765647c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f8c7c101: serviceaccount "payload-processing-e2e-ait-f8c7c101" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f8c7c101-857574d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f8c7c101-857574d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f8c7c101: serviceaccount "payload-processing-e2e-ait-f8c7c101" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f8c7c101-9d765647c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f8c7c101

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f8c7c101-9d765647c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f8c7c101

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f8c7c101-857574d9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f8c7c101-857574d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f8c7c101-857574d9d-87q24

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f8c7c101-9d765647c-lfxvq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-55340d68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-55340d68

openshift-ingress

deployment-controller

e2e-derive-55340d68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-55340d68-openshift-default-8475dc9fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-55340d68-openshift-default-8475dc9fb

SuccessfulCreate

Created pod: e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-55340d68-67b48c7677

FailedCreate

Error creating: pods "payload-processing-e2e-derive-55340d68-67b48c7677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-55340d68: serviceaccount "payload-processing-e2e-derive-55340d68" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-55340d68-67b48c7677

SuccessfulCreate

Created pod: payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

openshift-ingress

multus

payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-55340d68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-55340d68: serviceaccount "payload-processing-e2e-derive-55340d68" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-55340d68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-55340d68-67b48c7677 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-55340d68-68b8d8bfc8-5ndq9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-55340d68-67b48c7677-kpcwv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-44f561-768b76957d-975fv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-44f561-6c866756fc-kvlmv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-b3b22c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-b3b22c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-b3b22c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-b3b22c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 56b31cab-dd0f-4339-9e51-f32c21ebf74c, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-b3b22c-5b84b84bbb-cfb5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-b3b22c-5d6c5d7999-49rft

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-44f561-openshift-default-6f6685d5d-wl7nx

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-cf0ace-openshift-default-7f6884ff8d

SuccessfulCreate

Created pod: e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

openshift-ingress

gateway_labeler_controller

e2e-explicit-cf0ace

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-cf0ace

openshift-ingress

deployment-controller

e2e-explicit-cf0ace-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-cf0ace-openshift-default-7f6884ff8d from 0 to 1

openshift-ingress

multus

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-cf0ace

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-cf0ace-7885bcc98f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-cf0ace

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cf0ace: serviceaccount "payload-processing-e2e-explicit-cf0ace" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cf0ace-7885bcc98f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-cf0ace-7885bcc98f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cf0ace: serviceaccount "payload-processing-e2e-explicit-cf0ace" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cf0ace-7885bcc98f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

openshift-ingress

kubelet

payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-728f63f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-728f63f6

openshift-ingress

deployment-controller

e2e-mt-728f63f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-728f63f6-openshift-default-56b9895f68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-728f63f6-openshift-default-56b9895f68

SuccessfulCreate

Created pod: e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

openshift-ingress

multus

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-728f63f6-657bc55cf7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-728f63f6-657bc55cf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-728f63f6: serviceaccount "payload-processing-e2e-mt-728f63f6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-728f63f6-657bc55cf7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-728f63f6: serviceaccount "payload-processing-e2e-mt-728f63f6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-728f63f6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-728f63f6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-728f63f6-657bc55cf7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cf0ace-69dc9d55d6-p6wfl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cf0ace-7885bcc98f-9tkgj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-a136cc-openshift-default-7cc77f858

SuccessfulCreate

Created pod: e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

openshift-ingress

gateway_labeler_controller

e2e-noten-a136cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-a136cc

openshift-ingress

deployment-controller

e2e-noten-a136cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-a136cc-openshift-default-7cc77f858 from 0 to 1

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-728f63f6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-728f63f6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-728f63f6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-728f63f6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a8c98303-5d23-425f-86b4-21478eb4f4a5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-728f63f6-657bc55cf7-2kpd8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-728f63f6-77ddb8bf4-f47df

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-10325b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-10325b-openshift-default-674ffb986d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-10325b-openshift-default-674ffb986d

SuccessfulCreate

Created pod: e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-10325b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-10325b

openshift-ingress

multus

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-10325b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-10325b: serviceaccount "payload-processing-e2e-shared-a-w2-10325b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-10325b: serviceaccount "payload-processing-e2e-shared-a-w2-10325b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-10325b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-10325b-77b9b4db7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.587s (2.587s including waiting). Image size: 166453408 bytes.
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w2-0376cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d

SuccessfulCreate

Created pod: e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-0376cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-0376cd
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0376cd-78856d948f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-0376cd-78856d948f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd: serviceaccount "payload-processing-e2e-shared-b-w2-0376cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-0376cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-0376cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-0376cd-78856d948f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-0376cd-78856d948f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd: serviceaccount "payload-processing-e2e-shared-b-w2-0376cd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c4ce82-6c94fb46c8-6pgft

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c4ce82-5b766fc955-zmkzn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-b5fe4519

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b5fe4519

openshift-ingress

multus

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-b5fe4519-openshift-default-84cfc86584

SuccessfulCreate

Created pod: e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

openshift-ingress

deployment-controller

e2e-mt-b5fe4519-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b5fe4519-openshift-default-84cfc86584 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b5fe4519

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b5fe4519-b98fcfd77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b5fe4519-b98fcfd77

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b5fe4519: serviceaccount "payload-processing-e2e-mt-b5fe4519" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b5fe4519

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b5fe4519-b98fcfd77

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b5fe4519-b98fcfd77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b5fe4519: serviceaccount "payload-processing-e2e-mt-b5fe4519" not found

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-c4ce82-openshift-default-8555cd6c9b-bpw46

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5a005d-6cfdc9db6-6nhxm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5a005d-756b74fb85-bmnpx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-5a005d-openshift-default-cc9788f6b-twz5d

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-751f6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d

SuccessfulCreate

Created pod: e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-751f6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-751f6a

openshift-ingress

multus

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-751f6a: serviceaccount "payload-processing-e2e-shared-a-w3-751f6a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-751f6a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-751f6a: serviceaccount "payload-processing-e2e-shared-a-w3-751f6a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-751f6a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-751f6a-f5b56d759 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb

SuccessfulCreate

Created pod: e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

openshift-ingress

deployment-controller

e2e-shared-b-w3-bebef4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-bebef4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-bebef4

openshift-ingress

multus

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bebef4: serviceaccount "payload-processing-e2e-shared-b-w3-bebef4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bebef4: serviceaccount "payload-processing-e2e-shared-b-w3-bebef4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-bebef4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-bebef4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj

Unhealthy

Readiness probe failed: dial tcp 10.134.0.62:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b5fe4519-b4d97c6f8-n7pdx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b5fe4519-openshift-default-84cfc86584-vxfnt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-8e708f-55b689fd47-kv4kz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-8e708f-75fb8965d6-j4nrt

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-a-a7b600-openshift-default-c88cb89b8

SuccessfulCreate

Created pod: e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

openshift-ingress

deployment-controller

e2e-api-a-a7b600-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a7b600-openshift-default-c88cb89b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-a7b600

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a7b600

openshift-ingress

multus

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a7b600-79995f4d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a7b600-79995f4d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a7b600: serviceaccount "payload-processing-e2e-api-a-a7b600" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a7b600

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a7b600-79995f4d78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a7b600-d967c6dc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a7b600-d967c6dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a7b600: serviceaccount "payload-processing-e2e-api-a-a7b600" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a7b600

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a7b600-d967c6dc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a7b600-79995f4d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a7b600-d967c6dc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6
(x2)

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-29d76c-openshift-default-5c894f7888

SuccessfulCreate

Created pod: e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

openshift-ingress

gateway_labeler_controller

e2e-api-b-29d76c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-29d76c

openshift-ingress

deployment-controller

e2e-api-b-29d76c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-29d76c-openshift-default-5c894f7888 from 0 to 1

openshift-ingress

multus

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-29d76c-76d8fdbb7

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-29d76c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-29d76c-76957b86fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-29d76c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-29d76c-76d8fdbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-29d76c-76d8fdbb7

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-29d76c-76d8fdbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-29d76c: serviceaccount "payload-processing-e2e-api-b-29d76c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-29d76c-76957b86fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-29d76c-76957b86fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-29d76c: serviceaccount "payload-processing-e2e-api-b-29d76c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-29d76c-76957b86fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

openshift-ingress

kubelet

payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7b600-79995f4d78-clb6d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7b600-d967c6dc-h4hw6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-a7b600-openshift-default-c88cb89b8-jxm2q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-29d76c-openshift-default-5c894f7888-9hd9h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-10325b-fcdcc97c4-fvdmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq

Unhealthy

Readiness probe failed: dial tcp 10.134.0.60:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-a4edd7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-a4edd7

openshift-ingress

deployment-controller

e2e-ipp-a-a4edd7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-a4edd7-openshift-default-6575b56c84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-a4edd7-openshift-default-6575b56c84

SuccessfulCreate

Created pod: e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

openshift-ingress

multus

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a4edd7: serviceaccount "payload-processing-e2e-ipp-a-a4edd7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-a4edd7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a4edd7-864767777f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-a4edd7-864767777f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-a4edd7-864767777f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-a4edd7: serviceaccount "payload-processing-e2e-ipp-a-a4edd7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-a4edd7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-a4edd7-864767777f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-14de36-openshift-default-f54c94d4b

SuccessfulCreate

Created pod: e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-14de36

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-14de36

openshift-ingress

deployment-controller

e2e-ipp-b-14de36-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-14de36-openshift-default-f54c94d4b from 0 to 1

openshift-ingress

multus

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-14de36-6d6dc978d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-14de36-6d6dc978d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-14de36: serviceaccount "payload-processing-e2e-ipp-b-14de36" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-14de36: serviceaccount "payload-processing-e2e-ipp-b-14de36" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-14de36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-14de36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-14de36-6d6dc978d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-14de36-6d6dc978d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

ProbeError

Startup probe error: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

Unhealthy

Startup probe failed: Get "http://10.134.0.70:15021/healthz/ready": dial tcp 10.134.0.70:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-df8e58

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-df8e58

openshift-ingress

multus

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-df8e58-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58: serviceaccount "payload-processing-e2e-ipp-cleanup-df8e58" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58: serviceaccount "payload-processing-e2e-ipp-cleanup-df8e58" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-df8e58

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-df8e58

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

ProbeError

Startup probe error: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

Unhealthy

Startup probe failed: Get "http://10.134.0.72:15021/healthz/ready": dial tcp 10.134.0.72:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-df8e58-5d48d56fdb-j7gfp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-14de36-77dfd7748b-4q4zn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-751f6a-8546c5d9f8-zw744

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-751f6a-f5b56d759-n267t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-751f6a-openshift-default-549c5bdf4d-78c97

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-bebef4

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bebef4: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-bebef4": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bebef4, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: efd74635-84a0-4dc9-a328-a651943610a0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bebef4-f96b8f658-265wh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bebef4-6f75dbf44f-s242z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9

Killing

Stopping container istio-proxy