Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2 to ip-10-0-137-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5 to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx to ip-10-0-135-117.ec2.internal

openshift-ingress

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999 to ip-10-0-137-148.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-8prfq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-8prfq to ip-10-0-137-148.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-jgz67

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-jgz67 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9 to ip-10-0-135-117.ec2.internal

openshift-ingress

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Scheduled

Successfully assigned openshift-ingress/e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z to ip-10-0-137-148.ec2.internal

openshift-ingress

kube-auth-proxy-65d657c8d5-ptlv5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65d657c8d5-ptlv5 to ip-10-0-135-117.ec2.internal

openshift-ingress

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq to ip-10-0-140-126.ec2.internal

openshift-ingress

kube-auth-proxy-65d657c8d5-cww2l

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-65d657c8d5-cww2l to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-8n4mh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-8n4mh to ip-10-0-140-126.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hmc5c

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmc5c to ip-10-0-140-126.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-4lrb5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-4lrb5 to ip-10-0-137-148.ec2.internal

openshift-ingress

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs to ip-10-0-137-148.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2 to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8 to ip-10-0-137-148.ec2.internal

openshift-ingress

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8 to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf to ip-10-0-135-117.ec2.internal

openshift-ingress

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

Scheduled

Successfully assigned openshift-ingress/e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78 to ip-10-0-135-117.ec2.internal

openshift-ingress

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l to ip-10-0-135-117.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c24thp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c24thp to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg to ip-10-0-140-126.ec2.internal

openshift-ingress

router-default-6ff78776b6-sf6fh

Scheduled

Successfully assigned openshift-ingress/router-default-6ff78776b6-sf6fh to ip-10-0-137-148.ec2.internal

openshift-ingress

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27 to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Scheduled

Successfully assigned openshift-ingress/e2e-autores-2beba0-openshift-default-696968fc9d-d68zb to ip-10-0-135-117.ec2.internal

openshift-ingress

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5 to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-processing-e2e-autores-2beba0-c49869485-x7gk5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-2beba0-c49869485-x7gk5 to ip-10-0-137-148.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x to ip-10-0-137-148.ec2.internal

openshift-ingress

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8 to ip-10-0-140-126.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

Scheduled

Successfully assigned openshift-ingress/e2e-noten-a214cb-openshift-default-95b87f746-5x8lt to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

Scheduled

Successfully assigned openshift-ingress/e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9 to ip-10-0-135-117.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv to ip-10-0-140-126.ec2.internal

openshift-ingress

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz to ip-10-0-135-117.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6ff78776b6 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-6ff78776b6

FailedCreate

Error creating: pods "router-default-6ff78776b6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6ff78776b6

FailedCreate

Error creating: pods "router-default-6ff78776b6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6ff78776b6

SuccessfulCreate

Created pod: router-default-6ff78776b6-sf6fh
(x6)

openshift-ingress

kubelet

router-default-6ff78776b6-sf6fh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6ff78776b6-sf6fh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-6ff78776b6-sf6fh

Started

Started container router

openshift-ingress

kubelet

router-default-6ff78776b6-sf6fh

Created

Created container: router

openshift-ingress

kubelet

router-default-6ff78776b6-sf6fh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-6ff78776b6-sf6fh

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-65d657c8d5

FailedCreate

Error creating: pods "kube-auth-proxy-65d657c8d5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-65d657c8d5 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-65d657c8d5-cww2l

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-cww2l

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-65d657c8d5-ptlv5

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-ptlv5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-65d657c8d5

SuccessfulCreate

Created pod: kube-auth-proxy-65d657c8d5-cww2l

openshift-ingress

replicaset-controller

kube-auth-proxy-65d657c8d5

SuccessfulCreate

Created pod: kube-auth-proxy-65d657c8d5-ptlv5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hmc5c

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-cww2l

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.658s (2.658s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-cww2l

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hmc5c

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-cww2l

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-ptlv5

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-ptlv5

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-65d657c8d5-ptlv5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.705s (2.705s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.964s (2.964s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c24thp

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c24thp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c24thp

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c24thp

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c24thp

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c24thp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.65s (2.65s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-4lrb5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4lrb5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-4lrb5

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4lrb5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.543s (2.543s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4lrb5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-4lrb5

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hmc5c

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

Unhealthy

Readiness probe failed: Get "http://10.132.0.19:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmc5c

ProbeError

Readiness probe error: Get "http://10.132.0.19:8080/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-jgz67

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-jgz67

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-8n4mh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-8prfq

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8n4mh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-8prfq

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8prfq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-8n4mh

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8prfq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.907s (1.907s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8n4mh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8n4mh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8prfq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8prfq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-8n4mh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.062s (2.062s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-jgz67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-jgz67

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-jgz67

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-jgz67

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-jgz67

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-933e9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-933e9d-openshift-default-67976b7cc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-933e9d-openshift-default-67976b7cc8

SuccessfulCreate

Created pod: e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c7643f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c7643f

openshift-ingress

replicaset-controller

e2e-inf-a-c7643f-openshift-default-7985ccd8c6

SuccessfulCreate

Created pod: e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-933e9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-933e9d

openshift-ingress

multus

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64

SuccessfulCreate

Created pod: e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

openshift-ingress

deployment-controller

e2e-worker-w0-2b2343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-2b2343-openshift-default-6cbbc46f64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-2b2343

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-2b2343

openshift-ingress

deployment-controller

e2e-inf-a-c7643f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c7643f-openshift-default-7985ccd8c6 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-inf-a-c7643f-openshift-default-dockercfg-2fjv2); attempting to pull the image may not succeed.

openshift-ingress

multus

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-933e9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-933e9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-933e9d-765f6d6c57 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-933e9d: serviceaccount "payload-processing-e2e-worker-w4-933e9d" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-933e9d-765f6d6c57

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-933e9d-765f6d6c57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-933e9d: serviceaccount "payload-processing-e2e-worker-w4-933e9d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-933e9d-765f6d6c57

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-2b2343

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2b2343-58886c7587

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-2b2343-58886c7587-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2b2343: serviceaccount "payload-processing-e2e-worker-w0-2b2343" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-2b2343-58886c7587

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-2b2343

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-2b2343-58886c7587 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-2b2343: serviceaccount "payload-processing-e2e-worker-w0-2b2343" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c7643f-6664dffcdc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c7643f-ff467678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c7643f-ff467678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c7643f: serviceaccount "payload-processing-e2e-inf-a-c7643f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c7643f-ff467678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c7643f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c7643f-ff467678 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c7643f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c7643f-6664dffcdc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c7643f-6664dffcdc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c7643f-6664dffcdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c7643f: serviceaccount "payload-processing-e2e-inf-a-c7643f" not found

openshift-ingress

replicaset-controller

e2e-autores-2beba0-openshift-default-696968fc9d

SuccessfulCreate

Created pod: e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-2beba0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-2beba0

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-2beba0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-2beba0-openshift-default-696968fc9d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.78s (1.78s including waiting). Image size: 166449337 bytes.

openshift-ingress

deployment-controller

e2e-ait-04f122cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-04f122cb-openshift-default-564ffdcbb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-04f122cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-04f122cb

openshift-ingress

replicaset-controller

e2e-ait-04f122cb-openshift-default-564ffdcbb8

SuccessfulCreate

Created pod: e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.7s (2.7s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing-e2e-ait-04f122cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-04f122cb-6fd47bc995 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04f122cb-6fd47bc995

FailedCreate

Error creating: pods "payload-processing-e2e-ait-04f122cb-6fd47bc995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04f122cb: serviceaccount "payload-processing-e2e-ait-04f122cb" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04f122cb: serviceaccount "payload-processing-e2e-ait-04f122cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-04f122cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-04f122cb-c7757c6bb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04f122cb-6fd47bc995

SuccessfulCreate

Created pod: payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

openshift-ingress

multus

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-2beba0-c49869485

SuccessfulCreate

Created pod: payload-processing-e2e-autores-2beba0-c49869485-x7gk5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-2beba0: serviceaccount "payload-processing-e2e-autores-2beba0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-2beba0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-2beba0-75bcdf65f4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-2beba0-c49869485

FailedCreate

Error creating: pods "payload-processing-e2e-autores-2beba0-c49869485-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-2beba0: serviceaccount "payload-processing-e2e-autores-2beba0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-2beba0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-2beba0-c49869485 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-2beba0-c49869485-x7gk5

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-2beba0-c49869485-x7gk5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-2beba0-c49869485-x7gk5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-2beba0-c49869485-x7gk5

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

ProbeError

Readiness probe error: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Unhealthy

Readiness probe failed: Get "http://10.132.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-b2dd30

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-b2dd30

openshift-ingress

replicaset-controller

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66

SuccessfulCreate

Created pod: e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

openshift-ingress

deployment-controller

e2e-inf-b-b2dd30-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Started

Started container istio-proxy

openshift-ingress

multus

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-b2dd30

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b2dd30: serviceaccount "payload-processing-e2e-inf-b-b2dd30" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b2dd30-9585474c7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-b2dd30-9585474c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-b2dd30: serviceaccount "payload-processing-e2e-inf-b-b2dd30" not found
(x5)

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-b2dd30-9585474c7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-b2dd30

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-b2dd30-9585474c7 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-04f122cb-6fd47bc995-cxgcg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04f122cb-c7757c6bb-4pbjs

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-5333ad9e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-5333ad9e-gw

openshift-ingress

kubelet

e2e-ait-04f122cb-openshift-default-564ffdcbb8-d6czz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-5333ad9e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d from 0 to 1

openshift-ingress

multus

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d

SuccessfulCreate

Created pod: e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-5333ad9e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-5333ad9e-7b966f877d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-5333ad9e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5333ad9e-7b966f877d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-5333ad9e-7b966f877d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5333ad9e: serviceaccount "payload-processing-e2e-migrate-5333ad9e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5333ad9e-7b966f877d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5333ad9e: serviceaccount "payload-processing-e2e-migrate-5333ad9e" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-e2e-migrate-5333ad9e-dockercfg-zkqkq); attempting to pull the image may not succeed.

openshift-ingress

multus

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-5333ad9e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-5333ad9e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-5333ad9e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-5333ad9e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fe45d308-869b-44ed-a448-58f66422fa23, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-5333ad9e-7b966f877d-sr6tm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5333ad9e-6455dd8598-94qkv

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-fd5982ad

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-fd5982ad

openshift-ingress

kubelet

e2e-migrate-5333ad9e-gw-openshift-default-58cbbc958d-pqsps

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-fd5982ad-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-fd5982ad-openshift-default-568c668cfd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-fd5982ad-openshift-default-568c668cfd

SuccessfulCreate

Created pod: e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

openshift-ingress

multus

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fd5982ad-68884c9878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-fd5982ad-68884c9878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fd5982ad: serviceaccount "payload-processing-e2e-ait-fd5982ad" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-fd5982ad-68884c9878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-fd5982ad

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-fd5982ad-68884c9878 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-fd5982ad

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-fd5982ad-b68c4858f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fd5982ad-b68c4858f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-fd5982ad-b68c4858f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-fd5982ad-b68c4858f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-fd5982ad: serviceaccount "payload-processing-e2e-ait-fd5982ad" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-fd5982ad-68884c9878-89kgk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-fd5982ad-b68c4858f-rxzd9

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-derive-3d3c9036-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-3d3c9036-openshift-default-6fc54fffd4 from 0 to 1

openshift-ingress

kubelet

e2e-ait-fd5982ad-openshift-default-568c668cfd-6mwkl

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-3d3c9036-openshift-default-6fc54fffd4

SuccessfulCreate

Created pod: e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

openshift-ingress

gateway_labeler_controller

e2e-derive-3d3c9036

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-3d3c9036

openshift-ingress

multus

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-3d3c9036

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-3d3c9036-77c97b5774 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3d3c9036-6d7df7cf49

SuccessfulCreate

Created pod: payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-3d3c9036-6d7df7cf49

FailedCreate

Error creating: pods "payload-processing-e2e-derive-3d3c9036-6d7df7cf49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3d3c9036: serviceaccount "payload-processing-e2e-derive-3d3c9036" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-3d3c9036: serviceaccount "payload-processing-e2e-derive-3d3c9036" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-3d3c9036

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-3d3c9036-6d7df7cf49 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-2beba0-c49869485-x7gk5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-2beba0-75bcdf65f4-4s6m5

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-3d3c9036-6d7df7cf49-mjw27

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-3d3c9036-77c97b5774-lh985

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-3d3c9036-openshift-default-6fc54fffd4-nl64r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-2beba0-openshift-default-696968fc9d-d68zb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-2d6f6c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-2d6f6c-openshift-default-56f496fc48 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-2d6f6c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-2d6f6c

openshift-ingress

multus

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-2d6f6c-openshift-default-56f496fc48

SuccessfulCreate

Created pod: e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-2d6f6c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-2d6f6c-6b66d99bf7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-2d6f6c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2d6f6c: serviceaccount "payload-processing-e2e-explicit-2d6f6c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2d6f6c: serviceaccount "payload-processing-e2e-explicit-2d6f6c" not found

openshift-ingress

multus

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-999c8b38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-999c8b38-openshift-default-64745dd4cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-999c8b38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-999c8b38

openshift-ingress

replicaset-controller

e2e-mt-999c8b38-openshift-default-64745dd4cb

SuccessfulCreate

Created pod: e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

openshift-ingress

multus

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-999c8b38-5675f9b97c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-999c8b38: serviceaccount "payload-processing-e2e-mt-999c8b38" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-999c8b38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-999c8b38-5675f9b97c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-999c8b38-5675f9b97c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-999c8b38-5675f9b97c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-999c8b38: serviceaccount "payload-processing-e2e-mt-999c8b38" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-999c8b38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-999c8b38-7d558b8bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-999c8b38-7d558b8bb-65bx7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-999c8b38-5675f9b97c-x8dt5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-999c8b38-openshift-default-64745dd4cb-vqw78

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-78a7d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-78a7d5

openshift-ingress

replicaset-controller

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b

SuccessfulCreate

Created pod: e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

openshift-ingress

deployment-controller

e2e-shared-a-w2-78a7d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-78a7d5: serviceaccount "payload-processing-e2e-shared-a-w2-78a7d5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-78a7d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-78a7d5-7984758889

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-78a7d5-7984758889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-78a7d5: serviceaccount "payload-processing-e2e-shared-a-w2-78a7d5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-78a7d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-78a7d5-7984758889 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-78a7d5-7984758889

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2d6f6c-6b66d99bf7-n94lg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2d6f6c-575dbb4f5d-p4knr

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd

SuccessfulCreate

Created pod: e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

openshift-ingress

deployment-controller

e2e-shared-b-w2-3fa05f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-3fa05f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-3fa05f

openshift-ingress

multus

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-3fa05f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3fa05f: serviceaccount "payload-processing-e2e-shared-b-w2-3fa05f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-3fa05f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3fa05f: serviceaccount "payload-processing-e2e-shared-b-w2-3fa05f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-2d6f6c-openshift-default-56f496fc48-gxvl8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-noten-a214cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-a214cb

openshift-ingress

deployment-controller

e2e-noten-a214cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-a214cb-openshift-default-95b87f746 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-a214cb-openshift-default-95b87f746

SuccessfulCreate

Created pod: e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

openshift-ingress

multus

e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-mt-fbe7be47-openshift-default-699b77ffc6

SuccessfulCreate

Created pod: e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

openshift-ingress

deployment-controller

e2e-mt-fbe7be47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fbe7be47-openshift-default-699b77ffc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fbe7be47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fbe7be47

openshift-ingress

multus

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fbe7be47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fbe7be47: serviceaccount "payload-processing-e2e-mt-fbe7be47" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fbe7be47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fbe7be47: serviceaccount "payload-processing-e2e-mt-fbe7be47" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

openshift-ingress

kubelet

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": read tcp 10.132.0.2:50684->10.132.0.75:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": read tcp 10.132.0.2:50684->10.132.0.75:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c7643f-6664dffcdc-7h999

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c7643f-ff467678-fdtd2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-a214cb-openshift-default-95b87f746-5x8lt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-c7643f-openshift-default-7985ccd8c6-n6vhs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-b2dd30-76b6d4fdcd-5bjtx

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-b2dd30

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-b2dd30: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-b2dd30": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-b2dd30, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 70408ae8-0061-4958-b2e7-1212e824a2bf, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-b2dd30-9585474c7-6bc6l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-cb82f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-cb82f2

openshift-ingress

deployment-controller

e2e-shared-a-w3-cb82f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b

SuccessfulCreate

Created pod: e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

openshift-ingress

multus

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-b2dd30-openshift-default-7cfbdf9f66-dvmbz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-cb82f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cb82f2: serviceaccount "payload-processing-e2e-shared-a-w3-cb82f2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-cb82f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cb82f2: serviceaccount "payload-processing-e2e-shared-a-w3-cb82f2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-a2fb5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-a2fb5a

openshift-ingress

replicaset-controller

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476

SuccessfulCreate

Created pod: e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

openshift-ingress

multus

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-a2fb5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

ProbeError

Readiness probe error: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Unhealthy

Readiness probe failed: Get "http://10.134.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a2fb5a: serviceaccount "payload-processing-e2e-shared-b-w3-a2fb5a" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a2fb5a: serviceaccount "payload-processing-e2e-shared-b-w3-a2fb5a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-a2fb5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-a2fb5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fbe7be47-5cc978c9cd-kgd4l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fbe7be47-7d9ff5f7f7-cwqzf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-fbe7be47-openshift-default-699b77ffc6-ltlsn

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-ada93f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ada93f

openshift-ingress

deployment-controller

e2e-api-a-ada93f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ada93f-openshift-default-6ccc575b5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-ada93f-openshift-default-6ccc575b5b

SuccessfulCreate

Created pod: e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ada93f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ada93f-6644c6f586 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ada93f-7bc46f485f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ada93f-7bc46f485f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ada93f-7bc46f485f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ada93f: serviceaccount "payload-processing-e2e-api-a-ada93f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ada93f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ada93f-7bc46f485f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ada93f-6644c6f586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ada93f-6644c6f586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ada93f: serviceaccount "payload-processing-e2e-api-a-ada93f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ada93f-6644c6f586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-4e2f93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4e2f93

openshift-ingress

replicaset-controller

e2e-api-b-4e2f93-openshift-default-6c89b97f84

SuccessfulCreate

Created pod: e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

openshift-ingress

deployment-controller

e2e-api-b-4e2f93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4e2f93-openshift-default-6c89b97f84 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4e2f93: serviceaccount "payload-processing-e2e-api-b-4e2f93" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4e2f93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4e2f93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4e2f93-69d5dd988c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4e2f93-69d5dd988c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4e2f93-69d5dd988c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4e2f93-69d5dd988c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4e2f93: serviceaccount "payload-processing-e2e-api-b-4e2f93" not found
(x5)

openshift-ingress

kubelet

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-ada93f-7bc46f485f-rc58x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ada93f-6644c6f586-qvp5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ada93f-openshift-default-6ccc575b5b-64l7s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e2f93-69d5dd988c-lgxdw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e2f93-5c75cf57cd-bfjr8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-4e2f93-openshift-default-6c89b97f84-l6v4p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-2b2343-f69d4cbcd-jc55z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-2b2343-58886c7587-888t9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-2b2343-openshift-default-6cbbc46f64-zbp6l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-78a7d5-5d65765d-rxc87

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-78a7d5-7984758889-hlnp2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-78a7d5-openshift-default-55c457ff6b-gzvs8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3fa05f-dfffd6645-5lhzq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3fa05f-854bff7754-qzsrs

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-3fa05f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-3fa05f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3fa05f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 9572303a-e131-4a6e-bd79-5464698d8bd5, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-3fa05f-openshift-default-574c4fc8cd-dzsnn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-933e9d-765f6d6c57-8hz6n

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w4-933e9d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w4-933e9d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w4-933e9d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 58399f31-ee46-4369-874a-25eeeab7f355, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-933e9d-6c98c9bdb6-c72g8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-933e9d-openshift-default-67976b7cc8-pknms

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-35e9ca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-35e9ca

openshift-ingress

multus

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-35e9ca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-35e9ca-openshift-default-7b47c9798b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b

SuccessfulCreate

Created pod: e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-35e9ca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-35e9ca: serviceaccount "payload-processing-e2e-ipp-a-35e9ca" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-35e9ca-865685f9b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-35e9ca-865685f9b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-35e9ca: serviceaccount "payload-processing-e2e-ipp-a-35e9ca" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-35e9ca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-35e9ca-865685f9b9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-35e9ca-865685f9b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

openshift-ingress

multus

payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

ProbeError

Readiness probe error: Get "http://10.132.0.95:15021/healthz/ready": read tcp 10.132.0.2:39032->10.132.0.95:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Unhealthy

Readiness probe failed: Get "http://10.132.0.95:15021/healthz/ready": read tcp 10.132.0.2:39032->10.132.0.95:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2ff038

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2ff038

openshift-ingress

replicaset-controller

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd

SuccessfulCreate

Created pod: e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

openshift-ingress

deployment-controller

e2e-ipp-b-2ff038-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2ff038-openshift-default-5bf696b9fd from 0 to 1

openshift-ingress

multus

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2ff038

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2ff038-c79cc6b77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2ff038-c79cc6b77

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2ff038-c79cc6b77

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2ff038-c79cc6b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2ff038: serviceaccount "payload-processing-e2e-ipp-b-2ff038" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2ff038

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2ff038-6c87474886 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2ff038: serviceaccount "payload-processing-e2e-ipp-b-2ff038" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

openshift-ingress

deployment-controller

e2e-ipp-cleanup-334ee7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-334ee7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-334ee7

openshift-ingress

multus

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-334ee7: serviceaccount "payload-processing-e2e-ipp-cleanup-334ee7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-334ee7: serviceaccount "payload-processing-e2e-ipp-cleanup-334ee7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-334ee7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-334ee7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-334ee7

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-334ee7: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-334ee7": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-334ee7, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2305e87d-ef18-4a65-b24d-b22a51d16861, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-334ee7-75b8bbf789-nls7t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-334ee7-6fc9dc6c94-cw9gl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-334ee7-openshift-default-7bb6dd99f4-426mv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-35e9ca-7c9c5765f8-c4mjz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-35e9ca-865685f9b9-9wpt8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-35e9ca-openshift-default-7b47c9798b-hlsr5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ff038-c79cc6b77-ngjrb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ff038-6c87474886-pk5lv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2ff038-openshift-default-5bf696b9fd-j6p6n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cb82f2-7ddfb7d6d5-blmcj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cb82f2-997897b7d-7f6x9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-cb82f2-openshift-default-fb89c9c4b-qmpvc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a2fb5a-68f4b59cdc-tntwk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a2fb5a-5fc88b8db-jnmmc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-a2fb5a-openshift-default-7d6dffd476-xbdql

Killing

Stopping container istio-proxy