Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8 to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-wwd2p

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-wwd2p to ip-10-0-136-52.ec2.internal

openshift-ingress

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k to ip-10-0-136-52.ec2.internal

openshift-ingress

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

Scheduled

Successfully assigned openshift-ingress/e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47 to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8 to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9 to ip-10-0-136-52.ec2.internal

openshift-ingress

kube-auth-proxy-6cd84dd4ff-z94r4

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6cd84dd4ff-z94r4 to ip-10-0-136-52.ec2.internal

openshift-ingress

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Scheduled

Successfully assigned openshift-ingress/e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4 to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8 to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

Scheduled

Successfully assigned openshift-ingress/e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7 to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf to ip-10-0-132-94.ec2.internal

openshift-ingress

kube-auth-proxy-6cd84dd4ff-8zn5r

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6cd84dd4ff-8zn5r to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2 to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws to ip-10-0-132-94.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jlxh4 to ip-10-0-136-52.ec2.internal

openshift-ingress

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5 to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm to ip-10-0-136-52.ec2.internal

openshift-ingress

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49 to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775 to ip-10-0-132-94.ec2.internal

openshift-ingress

router-default-8587f4c686-59cps

Scheduled

Successfully assigned openshift-ingress/router-default-8587f4c686-59cps to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5 to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

Scheduled

Successfully assigned openshift-ingress/e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-kjc76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-kjc76 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr to ip-10-0-132-168.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5 to ip-10-0-132-94.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k to ip-10-0-132-94.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-z26w7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z26w7 to ip-10-0-136-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw to ip-10-0-132-168.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr to ip-10-0-132-168.ec2.internal

openshift-ingress

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m to ip-10-0-136-52.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-tqd44

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-tqd44 to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb to ip-10-0-132-94.ec2.internal

openshift-ingress

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92 to ip-10-0-132-94.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8587f4c686 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-8587f4c686

FailedCreate

Error creating: pods "router-default-8587f4c686-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-8587f4c686

FailedCreate

Error creating: pods "router-default-8587f4c686-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-8587f4c686

SuccessfulCreate

Created pod: router-default-8587f4c686-59cps
(x6)

openshift-ingress

kubelet

router-default-8587f4c686-59cps

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-8587f4c686-59cps

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-8587f4c686-59cps

AddedInterface

Add eth0 [10.133.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-8587f4c686-59cps

Started

Started container router

openshift-ingress

kubelet

router-default-8587f4c686-59cps

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-8587f4c686-59cps

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6cd84dd4ff from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6cd84dd4ff

FailedCreate

Error creating: pods "kube-auth-proxy-6cd84dd4ff-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6cd84dd4ff

SuccessfulCreate

Created pod: kube-auth-proxy-6cd84dd4ff-z94r4

openshift-ingress

multus

kube-auth-proxy-6cd84dd4ff-8zn5r

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-6cd84dd4ff

SuccessfulCreate

Created pod: kube-auth-proxy-6cd84dd4ff-8zn5r

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-8zn5r

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-z94r4

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-z94r4

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-z26w7

openshift-ingress

multus

kube-auth-proxy-6cd84dd4ff-z94r4

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-z26w7

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-8zn5r

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-8zn5r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.075s (3.075s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-z94r4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.6s (2.6s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-z94r4

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-z94r4

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6cd84dd4ff-8zn5r

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.555s (3.555s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-bk2sk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.572s (2.572s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-tqd44

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tqd44

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-tqd44

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tqd44

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tqd44

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tqd44

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 6.931s (6.931s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tqd44

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-tqd44

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-z26w7

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-z26w7

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-jlxh4

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.761s (2.761s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-wwd2p
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-kjc76

openshift-ingress

multus

payload-processing-5b54b7fbb7-wwd2p

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-kjc76

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kjc76

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwd2p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwd2p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.106s (2.106s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwd2p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kjc76

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.307s (2.307s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-wwd2p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kjc76

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kjc76

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jlxh4

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w0-1a444c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-1a444c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-1a444c

openshift-ingress

deployment-controller

e2e-worker-w4-942883-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-942883-openshift-default-56d4fb7cdd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-942883

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-942883

openshift-ingress

gateway_labeler_controller

e2e-inf-a-15c3ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-15c3ed

openshift-ingress

replicaset-controller

e2e-worker-w4-942883-openshift-default-56d4fb7cdd

SuccessfulCreate

Created pod: e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

openshift-ingress

deployment-controller

e2e-inf-a-15c3ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-15c3ed-openshift-default-c647c46dd from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-15c3ed-openshift-default-c647c46dd

SuccessfulCreate

Created pod: e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

openshift-ingress

replicaset-controller

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6

SuccessfulCreate

Created pod: e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

openshift-ingress

multus

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-15c3ed: serviceaccount "payload-processing-e2e-inf-a-15c3ed" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-15c3ed: serviceaccount "payload-processing-e2e-inf-a-15c3ed" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-15c3ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-15c3ed-759c7bb6b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-15c3ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-942883-78d6d7566c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-942883

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-942883-78d6d7566c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-942883-78d6d7566c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-942883-78d6d7566c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-942883: serviceaccount "payload-processing-e2e-worker-w4-942883" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-942883

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-fb8843

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-fb8843

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-942883: serviceaccount "payload-processing-e2e-worker-w4-942883" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-fb8843-openshift-default-7b9bb99b6d

SuccessfulCreate

Created pod: e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-fb8843-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-fb8843-openshift-default-7b9bb99b6d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1a444c-5455b8549c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-1a444c-5455b8549c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1a444c: serviceaccount "payload-processing-e2e-worker-w0-1a444c" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.178s (1.178s including waiting). Image size: 166449312 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-1a444c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-1a444c-9d7458574 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-1a444c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-1a444c-5455b8549c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1a444c-5455b8549c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1a444c: serviceaccount "payload-processing-e2e-worker-w0-1a444c" not found

openshift-ingress

multus

payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-8cbeacf3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-8cbeacf3

openshift-ingress

multus

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-8cbeacf3-openshift-default-557475794b

SuccessfulCreate

Created pod: e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

openshift-ingress

deployment-controller

e2e-ait-8cbeacf3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-8cbeacf3-openshift-default-557475794b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-3a81e5-openshift-default-8d7457b9d

SuccessfulCreate

Created pod: e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

openshift-ingress

deployment-controller

payload-processing-e2e-autores-fb8843

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-fb8843-75b6d98bf5 from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-b-3a81e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3a81e5-openshift-default-8d7457b9d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-fb8843

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-fb8843-5df889c6b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3a81e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3a81e5

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-fb8843-5df889c6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-fb8843-75b6d98bf5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-fb8843-75b6d98bf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-fb8843: serviceaccount "payload-processing-e2e-autores-fb8843" not found

openshift-ingress

multus

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-fb8843-5df889c6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-fb8843-5df889c6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-fb8843: serviceaccount "payload-processing-e2e-autores-fb8843" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-fb8843-75b6d98bf5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8cbeacf3-7db456cf65

FailedCreate

Error creating: pods "payload-processing-e2e-ait-8cbeacf3-7db456cf65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8cbeacf3: serviceaccount "payload-processing-e2e-ait-8cbeacf3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-8cbeacf3-7db456cf65

SuccessfulCreate

Created pod: payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-8cbeacf3: serviceaccount "payload-processing-e2e-ait-8cbeacf3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-8cbeacf3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-8cbeacf3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-8cbeacf3-7db456cf65 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3a81e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3a81e5-5c44bb67b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3a81e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3a81e5-974bb8998 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3a81e5: serviceaccount "payload-processing-e2e-inf-b-3a81e5" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3a81e5: serviceaccount "payload-processing-e2e-inf-b-3a81e5" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-8cbeacf3-7bbdc97b9d-49slj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-8cbeacf3-7db456cf65-xlwwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-8cbeacf3-openshift-default-557475794b-tfr47

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-f4465858-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f4465858-gw-openshift-default-67c7b4b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-f4465858-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f4465858-gw

openshift-ingress

replicaset-controller

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4

SuccessfulCreate

Created pod: e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92
(x2)

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f4465858

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f4465858-668c767b7d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f4465858

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f4465858-5d7655b65d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f4465858-668c767b7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f4465858-668c767b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f4465858: serviceaccount "payload-processing-e2e-migrate-f4465858" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f4465858-5d7655b65d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f4465858-5d7655b65d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f4465858-5d7655b65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f4465858: serviceaccount "payload-processing-e2e-migrate-f4465858" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f4465858-668c767b7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f4465858-668c767b7d-tpnjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f4465858-5d7655b65d-8sfj5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-f4465858-gw-openshift-default-67c7b4b4-78j92

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-980e4a32-openshift-default-58785f7db8

SuccessfulCreate

Created pod: e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

openshift-ingress

deployment-controller

e2e-ait-980e4a32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-980e4a32-openshift-default-58785f7db8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-980e4a32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-980e4a32

openshift-ingress

multus

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-980e4a32-b5b757c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-980e4a32-b5b757c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-980e4a32: serviceaccount "payload-processing-e2e-ait-980e4a32" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-980e4a32-b5b757c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-980e4a32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-980e4a32-b5b757c66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-980e4a32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-980e4a32-64d68f88d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-980e4a32-64d68f88d7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-980e4a32-64d68f88d7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-980e4a32-64d68f88d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-980e4a32: serviceaccount "payload-processing-e2e-ait-980e4a32" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-fb8843-5df889c6b6-9jpnk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-fb8843-75b6d98bf5-2t7cq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-980e4a32-b5b757c66-f9wm5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-980e4a32-64d68f88d7-qn8rx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-980e4a32-openshift-default-58785f7db8-xvg7z

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-3341b20d-openshift-default-648b5b67c6

SuccessfulCreate

Created pod: e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

openshift-ingress

deployment-controller

e2e-derive-3341b20d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3341b20d-openshift-default-648b5b67c6 from 0 to 1

openshift-ingress

multus

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-3341b20d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3341b20d

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3341b20d-7c988b4657

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3341b20d-7c988b4657

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3341b20d-7c988b4657-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3341b20d: serviceaccount "payload-processing-e2e-derive-3341b20d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3341b20d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3341b20d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3341b20d-7c988b4657 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3341b20d: serviceaccount "payload-processing-e2e-derive-3341b20d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

FailedMount

MountVolume.SetUp failed for volume "plugins-config-volume" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-cc7def

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-cc7def

openshift-ingress

deployment-controller

e2e-explicit-cc7def-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-cc7def-openshift-default-8497c9d7b8 from 0 to 1

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-cc7def-openshift-default-8497c9d7b8

SuccessfulCreate

Created pod: e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

openshift-ingress

kubelet

payload-processing-e2e-derive-3341b20d-7c988b4657-vxkgs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-3341b20d-openshift-default-648b5b67c6-qbxbb

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3341b20d-57d8cfc69d-bbpwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-fb8843-openshift-default-7b9bb99b6d-fxpd4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-cc7def

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-cc7def-6bf559969c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cc7def-6bf559969c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-cc7def-6bf559969c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cc7def: serviceaccount "payload-processing-e2e-explicit-cc7def" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-cc7def

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-cc7def-cc46d9b98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-cc7def: serviceaccount "payload-processing-e2e-explicit-cc7def" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

openshift-ingress

multus

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-cc7def-6bf559969c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-fa6711c6-openshift-default-748fb7d48

SuccessfulCreate

Created pod: e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

openshift-ingress

multus

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-fa6711c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fa6711c6-openshift-default-748fb7d48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fa6711c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fa6711c6

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fa6711c6-6ff6b757cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fa6711c6-6ff6b757cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fa6711c6-6ff6b757cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fa6711c6: serviceaccount "payload-processing-e2e-mt-fa6711c6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fa6711c6: serviceaccount "payload-processing-e2e-mt-fa6711c6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fa6711c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fa6711c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fa6711c6-6ff6b757cc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-cc7def-6bf559969c-tq6h4

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-cc7def

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-cc7def: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-cc7def": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-cc7def, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f0d64a7-178b-4911-a9dc-810375b53649, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-cc7def-cc46d9b98-p7775

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-fa6711c6-6ff6b757cc-4qjkg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa6711c6-7587c5d7fd-7v562

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-fa6711c6-openshift-default-748fb7d48-9zqf5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-shared-a-w2-3b5822-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-3b5822-openshift-default-6c5c444698 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-3b5822

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-3b5822

openshift-ingress

replicaset-controller

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698

SuccessfulCreate

Created pod: e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

openshift-ingress

multus

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-cc7def-openshift-default-8497c9d7b8-422v8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-9674d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-9674d9

openshift-ingress

deployment-controller

e2e-noten-9674d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-9674d9-openshift-default-5bcb885b7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-9674d9-openshift-default-5bcb885b7d

SuccessfulCreate

Created pod: e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

openshift-ingress

multus

e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

Created

Created container: istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3b5822-768946f969

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-3b5822-768946f969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3b5822: serviceaccount "payload-processing-e2e-shared-a-w2-3b5822" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-3b5822

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-3b5822-768946f969 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3b5822-768946f969

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3b5822: serviceaccount "payload-processing-e2e-shared-a-w2-3b5822" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-3b5822

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": read tcp 10.133.0.2:55712->10.133.0.63:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": read tcp 10.133.0.2:55712->10.133.0.63:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-4805a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-4805a7

openshift-ingress

deployment-controller

e2e-shared-b-w2-4805a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78

SuccessfulCreate

Created pod: e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-4805a7

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-4805a7-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-4805a7-authn-ssl" already exists
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4805a7-54478f677

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-4805a7-54478f677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4805a7: serviceaccount "payload-processing-e2e-shared-b-w2-4805a7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-4805a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-4805a7-54478f677 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-4805a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-4805a7: serviceaccount "payload-processing-e2e-shared-b-w2-4805a7" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-4805a7-54478f677

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-15c3ed-bd96fd686-r2b4x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-15c3ed-759c7bb6b7-rh99k

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-4ac9ac7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4ac9ac7d

openshift-ingress

deployment-controller

e2e-mt-4ac9ac7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4ac9ac7d-openshift-default-b4b5986b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8

SuccessfulCreate

Created pod: e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

openshift-ingress

multus

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-15c3ed-openshift-default-c647c46dd-c5rkv

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4ac9ac7d: serviceaccount "payload-processing-e2e-mt-4ac9ac7d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4ac9ac7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4ac9ac7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4ac9ac7d: serviceaccount "payload-processing-e2e-mt-4ac9ac7d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

openshift-ingress

multus

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3a81e5-974bb8998-5nkkw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3a81e5-5c44bb67b9-m4vwr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-9674d9-openshift-default-5bcb885b7d-5vt49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8

SuccessfulCreate

Created pod: e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

openshift-ingress

multus

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-feb80d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-feb80d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-feb80d

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

ProbeError

Readiness probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-3a81e5-openshift-default-8d7457b9d-qkbb8

Unhealthy

Readiness probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-feb80d-8567887949

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-feb80d: serviceaccount "payload-processing-e2e-shared-a-w3-feb80d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-feb80d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-feb80d-8567887949

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-feb80d-8567887949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-feb80d: serviceaccount "payload-processing-e2e-shared-a-w3-feb80d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-feb80d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-feb80d-8567887949 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb

SuccessfulCreate

Created pod: e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

openshift-ingress

deployment-controller

e2e-shared-b-w3-19944d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-19944d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-19944d

openshift-ingress

multus

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-19944d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-19944d: serviceaccount "payload-processing-e2e-shared-b-w3-19944d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-19944d: serviceaccount "payload-processing-e2e-shared-b-w3-19944d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-19944d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-4ac9ac7d-56bcd4ddf-b8v6t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4ac9ac7d-698cdc48bb-2lc5t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-4ac9ac7d-openshift-default-b4b5986b8-ltq7m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-api-a-1d6196

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-1d6196

openshift-ingress

deployment-controller

e2e-api-a-1d6196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-1d6196-openshift-default-64596f7bbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-1d6196-openshift-default-64596f7bbb

SuccessfulCreate

Created pod: e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

openshift-ingress

multus

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-1d6196

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-1d6196-6dcb449977 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-1d6196

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1d6196: serviceaccount "payload-processing-e2e-api-a-1d6196" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1d6196-6dcb449977

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-1d6196-6dcb449977-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-1d6196: serviceaccount "payload-processing-e2e-api-a-1d6196" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-1d6196-6dcb449977

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-60d8bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-60d8bd
(x2)

openshift-ingress

kubelet

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

Started

Started container istio-proxy

openshift-ingress

multus

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-60d8bd-openshift-default-774ff987d6

SuccessfulCreate

Created pod: e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

openshift-ingress

deployment-controller

e2e-api-b-60d8bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-60d8bd-openshift-default-774ff987d6 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-60d8bd-78cb989877

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-60d8bd-78cb989877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-60d8bd: serviceaccount "payload-processing-e2e-api-b-60d8bd" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-60d8bd: serviceaccount "payload-processing-e2e-api-b-60d8bd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-60d8bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-60d8bd-68f67f5566 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-60d8bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-60d8bd-78cb989877 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-60d8bd-78cb989877

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1a444c-5455b8549c-55shn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1a444c-9d7458574-6xtj5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-1a444c-openshift-default-7bfcdf88d6-w4wgc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

Unhealthy

Readiness probe failed: dial tcp 10.134.0.74:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-1d6196-5c7b57bd9d-d9wxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-1d6196-6dcb449977-fglkr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-1d6196-openshift-default-64596f7bbb-sdv8w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-60d8bd-68f67f5566-6vfr2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-60d8bd-78cb989877-tq8xz

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-60d8bd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-60d8bd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-60d8bd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-60d8bd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a4a80b44-09e3-4376-b6f3-3da3bb7e583c, UID in object meta:

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-60d8bd-openshift-default-774ff987d6-gh7gm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-942883-7b8bb69f78-prnll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-942883-78d6d7566c-vb2vr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3b5822-768946f969-82bj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3b5822-7fb57c7f8-wlbws

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-942883-openshift-default-56d4fb7cdd-4nxwz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-3b5822-openshift-default-6c5c444698-lvr52

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-4805a7-54478f677-dl8s5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-4805a7-657b9d9b4b-sf9g7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-4805a7-openshift-default-65f86d8c78-9kv8k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f8cdfc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f8cdfc

openshift-ingress

deployment-controller

e2e-ipp-a-f8cdfc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f8cdfc-openshift-default-8586f775cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd

SuccessfulCreate

Created pod: e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

openshift-ingress

multus

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f8cdfc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f8cdfc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f8cdfc-db59846bf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f8cdfc-db59846bf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f8cdfc-db59846bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f8cdfc: serviceaccount "payload-processing-e2e-ipp-a-f8cdfc" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f8cdfc: serviceaccount "payload-processing-e2e-ipp-a-f8cdfc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

openshift-ingress

multus

payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f8cdfc-db59846bf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-8f9642

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-8f9642

openshift-ingress

deployment-controller

e2e-ipp-b-8f9642-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-8f9642-openshift-default-64bbbb9d86 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86

SuccessfulCreate

Created pod: e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

openshift-ingress

multus

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-8f9642

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-8f9642-77f9f4769c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-8f9642

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8f9642-77f9f4769c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8f9642: serviceaccount "payload-processing-e2e-ipp-b-8f9642" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-8f9642-77f9f4769c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-8f9642-77f9f4769c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-8f9642: serviceaccount "payload-processing-e2e-ipp-b-8f9642" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-790775

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-790775

openshift-ingress

deployment-controller

e2e-ipp-cleanup-790775-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-790775: serviceaccount "payload-processing-e2e-ipp-cleanup-790775" not found
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-790775: serviceaccount "payload-processing-e2e-ipp-cleanup-790775" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-790775

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-790775

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

ProbeError

Startup probe error: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Unhealthy

Startup probe failed: Get "http://10.133.0.90:15021/healthz/ready": dial tcp 10.133.0.90:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-790775-769fcbbfcc-2h59x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-790775-7dcf494dc4-dk2m4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-790775-openshift-default-86bfc84fbb-s4s49

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8cdfc-84bdd86fc4-pppll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8cdfc-db59846bf-l6t8w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f8cdfc-openshift-default-8586f775cd-lnkf9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-8f9642-77f9f4769c-x5rwr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-8f9642-c46b77db6-tphpv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-8f9642-openshift-default-64bbbb9d86-h8ldn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-feb80d-8567887949-snvdc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-feb80d-7d8b8468c4-mcxrh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-feb80d-openshift-default-6ffffdfc8-g52xb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-19944d-6865d7bbf5-9mhfd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-19944d-7df8bf869d-sd6vf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-19944d-openshift-default-6bf6bf4dcb-n7nnq

Killing

Stopping container istio-proxy