Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw to ip-10-0-129-16.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8 to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

Scheduled

Successfully assigned openshift-ingress/e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98 to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2 to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7 to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj to ip-10-0-139-55.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-phnkt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-phnkt to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9 to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh to ip-10-0-129-16.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-vklds

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-vklds to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6 to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-8fw8g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-8fw8g to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl to ip-10-0-139-55.ec2.internal

openshift-ingress

kube-auth-proxy-86dc75d4b5-ls4xg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86dc75d4b5-ls4xg to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x to ip-10-0-129-16.ec2.internal

openshift-ingress

kube-auth-proxy-86dc75d4b5-bzxf7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86dc75d4b5-bzxf7 to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8 to ip-10-0-129-16.ec2.internal

openshift-ingress

router-default-764b645cd6-x9x9r

Scheduled

Successfully assigned openshift-ingress/router-default-764b645cd6-x9x9r to ip-10-0-139-55.ec2.internal

openshift-ingress

router-default-764b645cd6-x9x9r

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh to ip-10-0-139-55.ec2.internal

openshift-ingress

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Scheduled

Successfully assigned openshift-ingress/e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46 to ip-10-0-129-16.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6kbxk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6kbxk to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-9v8fj

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-9v8fj to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc to ip-10-0-143-120.ec2.internal

openshift-ingress

payload-processing-e2e-autores-ae7021-648bccd949-qvzld

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-ae7021-648bccd949-qvzld to ip-10-0-139-55.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b to ip-10-0-129-16.ec2.internal

openshift-ingress

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825 to ip-10-0-143-120.ec2.internal

openshift-ingress

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622 to ip-10-0-129-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk to ip-10-0-129-16.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-764b645cd6 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x10)

openshift-ingress

replicaset-controller

router-default-764b645cd6

FailedCreate

Error creating: pods "router-default-764b645cd6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-764b645cd6

FailedCreate

Error creating: pods "router-default-764b645cd6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-764b645cd6

SuccessfulCreate

Created pod: router-default-764b645cd6-x9x9r
(x6)

openshift-ingress

kubelet

router-default-764b645cd6-x9x9r

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-764b645cd6-x9x9r

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-764b645cd6-x9x9r

Created

Created container: router

openshift-ingress

kubelet

router-default-764b645cd6-x9x9r

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

multus

router-default-764b645cd6-x9x9r

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-764b645cd6-x9x9r

Started

Started container router

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-bzxf7

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-ls4xg

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-86dc75d4b5

FailedCreate

Error creating: pods "kube-auth-proxy-86dc75d4b5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-86dc75d4b5

SuccessfulCreate

Created pod: kube-auth-proxy-86dc75d4b5-ls4xg

openshift-ingress

replicaset-controller

kube-auth-proxy-86dc75d4b5

SuccessfulCreate

Created pod: kube-auth-proxy-86dc75d4b5-bzxf7

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-86dc75d4b5 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-bzxf7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-ls4xg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-86dc75d4b5-ls4xg

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-86dc75d4b5-bzxf7

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6kbxk

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6kbxk

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-bzxf7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-bzxf7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-bzxf7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.857s (2.857s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-ls4xg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

Started

Started container discovery

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-ls4xg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.97s (3.97s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.039s (3.039s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86dc75d4b5-ls4xg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.906s (2.906s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kl5k8

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-vklds

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-vklds

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vklds

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vklds

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vklds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6kbxk

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6kbxk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-phnkt

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-phnkt

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-9v8fj

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-8fw8g

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9v8fj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-8fw8g

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8fw8g

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-9v8fj

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9v8fj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9v8fj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.468s (1.468s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9v8fj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8fw8g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8fw8g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-8fw8g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.544s (1.544s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-phnkt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-phnkt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-phnkt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-phnkt

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-phnkt

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-93827d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-93827d-openshift-default-6c5bbfcf98 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98

SuccessfulCreate

Created pod: e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

openshift-ingress

deployment-controller

e2e-inf-a-dc2cee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-dc2cee-openshift-default-867445f5f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-4d9222

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-4d9222

openshift-ingress

replicaset-controller

e2e-inf-a-dc2cee-openshift-default-867445f5f4

SuccessfulCreate

Created pod: e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-93827d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-93827d

openshift-ingress

deployment-controller

e2e-worker-w0-4d9222-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-4d9222-openshift-default-849bc99f86 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-dc2cee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-dc2cee

openshift-ingress

multus

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-4d9222-openshift-default-849bc99f86

SuccessfulCreate

Created pod: e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.727s (2.727s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4d9222: serviceaccount "payload-processing-e2e-worker-w0-4d9222" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4d9222-6f754b67b5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-4d9222-6f754b67b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-4d9222: serviceaccount "payload-processing-e2e-worker-w0-4d9222" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-4d9222-6f754b67b5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-4d9222

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-4d9222

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-4d9222-6f754b67b5 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-93827d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-93827d-d6d7cb69c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-93827d-d6d7cb69c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-93827d-d6d7cb69c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-93827d: serviceaccount "payload-processing-e2e-worker-w4-93827d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-93827d-d6d7cb69c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-93827d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-93827d: serviceaccount "payload-processing-e2e-worker-w4-93827d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

openshift-ingress

deployment-controller

e2e-autores-ae7021-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-ae7021-openshift-default-c8f6c5fc4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.302s (1.302s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-autores-ae7021-openshift-default-c8f6c5fc4

SuccessfulCreate

Created pod: e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

openshift-ingress

gateway_labeler_controller

e2e-autores-ae7021

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-ae7021

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-dc2cee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-dc2cee-647f88fd5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-dc2cee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd from 0 to 1

openshift-ingress

multus

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dc2cee-647f88fd5c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dc2cee: serviceaccount "payload-processing-e2e-inf-a-dc2cee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-dc2cee-647f88fd5c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-dc2cee-647f88fd5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-dc2cee: serviceaccount "payload-processing-e2e-inf-a-dc2cee" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-ait-eeb0a3f4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-eeb0a3f4

openshift-ingress

deployment-controller

e2e-ait-eeb0a3f4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-eeb0a3f4-openshift-default-77b7b5576 from 0 to 1

openshift-ingress

multus

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-eeb0a3f4-openshift-default-77b7b5576

SuccessfulCreate

Created pod: e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.579s (2.579s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-eeb0a3f4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-eeb0a3f4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-eeb0a3f4-595b879cbc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eeb0a3f4-595b879cbc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-eeb0a3f4-595b879cbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eeb0a3f4: serviceaccount "payload-processing-e2e-ait-eeb0a3f4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-eeb0a3f4: serviceaccount "payload-processing-e2e-ait-eeb0a3f4" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

openshift-ingress

multus

payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-eeb0a3f4-595b879cbc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

openshift-ingress

kubelet

payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ae7021-648bccd949

FailedCreate

Error creating: pods "payload-processing-e2e-autores-ae7021-648bccd949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ae7021: serviceaccount "payload-processing-e2e-autores-ae7021" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-ae7021

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-ae7021-648bccd949 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-ae7021

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-ae7021-cf568849d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-ae7021-648bccd949-qvzld

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ae7021-648bccd949-qvzld

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ae7021-cf568849d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ae7021-cf568849d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-ae7021-cf568849d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ae7021: serviceaccount "payload-processing-e2e-autores-ae7021" not found

openshift-ingress

multus

payload-processing-e2e-autores-ae7021-648bccd949-qvzld

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-ae7021-648bccd949-qvzld

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ae7021-648bccd949

SuccessfulCreate

Created pod: payload-processing-e2e-autores-ae7021-648bccd949-qvzld
(x2)

openshift-ingress

kubelet

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-ee8a08-openshift-default-76fb6bd766

SuccessfulCreate

Created pod: e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

openshift-ingress

gateway_labeler_controller

e2e-inf-b-ee8a08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-ee8a08

openshift-ingress

multus

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-ee8a08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-ee8a08-openshift-default-76fb6bd766 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ee8a08-868557b686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-ee8a08-868557b686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-ee8a08-868557b686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ee8a08: serviceaccount "payload-processing-e2e-inf-b-ee8a08" not found
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ee8a08-8665f8d76f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-ee8a08-8665f8d76f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-ee8a08: serviceaccount "payload-processing-e2e-inf-b-ee8a08" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-ee8a08-8665f8d76f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-ee8a08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-ee8a08-8665f8d76f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-ee8a08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-ee8a08-868557b686 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-e2e-inf-b-ee8a08-dockercfg-6qxwq); attempting to pull the image may not succeed.
(x5)

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-eeb0a3f4-595b879cbc-7zh7w

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-eeb0a3f4-6df86bf4f8-vzl5l

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8

SuccessfulCreate

Created pod: e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

openshift-ingress

deployment-controller

e2e-migrate-5f7e430d-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-5f7e430d-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-5f7e430d-gw

openshift-ingress

multus

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-eeb0a3f4-openshift-default-77b7b5576-db42m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5f7e430d: serviceaccount "payload-processing-e2e-migrate-5f7e430d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-5f7e430d: serviceaccount "payload-processing-e2e-migrate-5f7e430d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-5f7e430d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-5f7e430d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-5f7e430d-96fbcbdd6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-5f7e430d-96fbcbdd6-2qm99

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-5f7e430d-67b67c94f4-vlwmn

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-35b94378-openshift-default-64dfbc5c4

SuccessfulCreate

Created pod: e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

openshift-ingress

deployment-controller

e2e-ait-35b94378-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-35b94378-openshift-default-64dfbc5c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-35b94378

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-35b94378

openshift-ingress

multus

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-5f7e430d-gw-openshift-default-56c9bfbb8-ghlx9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ait-35b94378

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-35b94378-6cddc4947c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-35b94378

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-35b94378-5688bcc74b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-35b94378-6cddc4947c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-35b94378-6cddc4947c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-35b94378: serviceaccount "payload-processing-e2e-ait-35b94378" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-35b94378-6cddc4947c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-35b94378-5688bcc74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-35b94378-5688bcc74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-35b94378: serviceaccount "payload-processing-e2e-ait-35b94378" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-35b94378-5688bcc74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

openshift-ingress

multus

payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-ae7021-648bccd949-qvzld

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ae7021-cf568849d-44ppj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-35b94378-5688bcc74b-dqxqz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-35b94378-6cddc4947c-44bf7

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-35b94378-openshift-default-64dfbc5c4-66hqr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-a721b5af-openshift-default-7c7cdb57c6

SuccessfulCreate

Created pod: e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

openshift-ingress

deployment-controller

e2e-derive-a721b5af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a721b5af-openshift-default-7c7cdb57c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-a721b5af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a721b5af
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a721b5af-5bcf9c6877

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a721b5af-5bcf9c6877-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a721b5af: serviceaccount "payload-processing-e2e-derive-a721b5af" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a721b5af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a721b5af-5bcf9c6877 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a721b5af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a721b5af-858fff4c46 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a721b5af-5bcf9c6877

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

openshift-ingress

multus

payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a721b5af-858fff4c46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a721b5af-858fff4c46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a721b5af-858fff4c46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a721b5af: serviceaccount "payload-processing-e2e-derive-a721b5af" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-e11b4c-openshift-default-7d48d9588d

SuccessfulCreate

Created pod: e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

openshift-ingress

gateway_labeler_controller

e2e-explicit-e11b4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-e11b4c

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-ae7021-openshift-default-c8f6c5fc4-gdcxb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-explicit-e11b4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-e11b4c-openshift-default-7d48d9588d from 0 to 1

openshift-ingress

multus

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-e11b4c: serviceaccount "payload-processing-e2e-explicit-e11b4c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-e11b4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-e11b4c-676cdf8446 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-e11b4c-6876b46f7c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-e11b4c-6876b46f7c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-e11b4c-6876b46f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-e11b4c: serviceaccount "payload-processing-e2e-explicit-e11b4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-e11b4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-e11b4c-6876b46f7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a721b5af-858fff4c46-lhcg9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-a721b5af-5bcf9c6877-7qmm9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-a721b5af-openshift-default-7c7cdb57c6-lqd4l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-834b7e2a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-834b7e2a

openshift-ingress

deployment-controller

e2e-mt-834b7e2a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-834b7e2a-openshift-default-85c77cbb48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-834b7e2a-openshift-default-85c77cbb48

SuccessfulCreate

Created pod: e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

openshift-ingress

multus

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-834b7e2a-596bb74754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-834b7e2a-596bb74754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-834b7e2a-596bb74754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-834b7e2a: serviceaccount "payload-processing-e2e-mt-834b7e2a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-834b7e2a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-834b7e2a-596bb74754 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-834b7e2a-5df45fd99c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-834b7e2a-5df45fd99c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-834b7e2a: serviceaccount "payload-processing-e2e-mt-834b7e2a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-834b7e2a-5df45fd99c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

openshift-ingress

deployment-controller

payload-processing-e2e-mt-834b7e2a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-834b7e2a-5df45fd99c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-e11b4c-6876b46f7c-xxvlx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-e11b4c-676cdf8446-67jbs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-e11b4c-openshift-default-7d48d9588d-zn825

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-e8ad4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-e8ad4e

openshift-ingress

kubelet

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-e8ad4e-openshift-default-f567666bb

SuccessfulCreate

Created pod: e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

openshift-ingress

deployment-controller

e2e-noten-e8ad4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-e8ad4e-openshift-default-f567666bb from 0 to 1

openshift-ingress

kubelet

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Unhealthy

Readiness probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

ProbeError

Readiness probe error: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-834b7e2a-596bb74754-pc98g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-834b7e2a-5df45fd99c-4t8l6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-e8ad4e-openshift-default-f567666bb-w66gk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-834b7e2a-openshift-default-85c77cbb48-lcst2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-526b97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-526b97-openshift-default-7dfbd688d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d

SuccessfulCreate

Created pod: e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-526b97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-526b97

openshift-ingress

multus

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-526b97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-526b97: serviceaccount "payload-processing-e2e-shared-a-w2-526b97" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-526b97: serviceaccount "payload-processing-e2e-shared-a-w2-526b97" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-526b97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-526b97-7bf5747d47 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-dc2cee-647f88fd5c-6qkz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-dc2cee-79685b4ffd-lqfbh

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-216d39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-216d39

openshift-ingress

replicaset-controller

e2e-shared-b-w2-216d39-openshift-default-5897964574

SuccessfulCreate

Created pod: e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

openshift-ingress

deployment-controller

e2e-shared-b-w2-216d39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-216d39-openshift-default-5897964574 from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-dc2cee-openshift-default-867445f5f4-4z6bh

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Unhealthy

Readiness probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

ProbeError

Readiness probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-216d39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-216d39-59959cc765 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-216d39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-216d39-59959cc765

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-216d39-59959cc765-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-216d39: serviceaccount "payload-processing-e2e-shared-b-w2-216d39" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-216d39: serviceaccount "payload-processing-e2e-shared-b-w2-216d39" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-216d39-59959cc765

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes
(x8)

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x8)

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-ee8a08-8665f8d76f-h2p2f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-ee8a08-868557b686-h5jr6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-ee8a08-openshift-default-76fb6bd766-t9rwh

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d

SuccessfulCreate

Created pod: e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

openshift-ingress

deployment-controller

e2e-shared-a-w3-ae54af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-ae54af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-ae54af

openshift-ingress

gateway_labeler_controller

e2e-mt-988c9d38

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-988c9d38

openshift-ingress

replicaset-controller

e2e-mt-988c9d38-openshift-default-79975f7f6d

SuccessfulCreate

Created pod: e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

openshift-ingress

deployment-controller

e2e-mt-988c9d38-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-988c9d38-openshift-default-79975f7f6d from 0 to 1

openshift-ingress

multus

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ae54af: serviceaccount "payload-processing-e2e-shared-a-w3-ae54af" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-ae54af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-ae54af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-ae54af: serviceaccount "payload-processing-e2e-shared-a-w3-ae54af" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.456s (2.456s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-mt-988c9d38

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-988c9d38-55cc7688d9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-988c9d38

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-988c9d38-7b49d89946 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-988c9d38-7b49d89946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-988c9d38-7b49d89946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-988c9d38-7b49d89946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-988c9d38: serviceaccount "payload-processing-e2e-mt-988c9d38" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-988c9d38-55cc7688d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-988c9d38-55cc7688d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-988c9d38: serviceaccount "payload-processing-e2e-mt-988c9d38" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-988c9d38-55cc7688d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-980661

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-980661

openshift-ingress

replicaset-controller

e2e-shared-b-w3-980661-openshift-default-59bff6f966

SuccessfulCreate

Created pod: e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

openshift-ingress

deployment-controller

e2e-shared-b-w3-980661-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-980661-openshift-default-59bff6f966 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

ProbeError

Readiness probe error: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Unhealthy

Readiness probe failed: Get "http://10.133.0.50:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-980661

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-980661-77765769cc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-980661-77765769cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-980661: serviceaccount "payload-processing-e2e-shared-b-w3-980661" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-980661-77765769cc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-980661: serviceaccount "payload-processing-e2e-shared-b-w3-980661" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-980661

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-980661-77765769cc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Unhealthy

Readiness probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

ProbeError

Readiness probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Unhealthy

Startup probe failed: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

ProbeError

Startup probe error: Get "http://10.133.0.53:15021/healthz/ready": dial tcp 10.133.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-988c9d38-7b49d89946-fxv7s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-988c9d38-55cc7688d9-8p622

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-988c9d38-openshift-default-79975f7f6d-99f4k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-4d9222-67d45969f8-gwf8b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-4d9222-6f754b67b5-d8grx

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-api-a-e01050-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-e01050-openshift-default-74cdc89bdb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-e01050

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-e01050

openshift-ingress

replicaset-controller

e2e-api-a-e01050-openshift-default-74cdc89bdb

SuccessfulCreate

Created pod: e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

openshift-ingress

multus

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w0-4d9222-openshift-default-849bc99f86-v5mg4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-e01050

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-e01050-6896bdcc57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-e01050

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-e01050-69565475c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e01050-6896bdcc57

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e01050-69565475c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-e01050-6896bdcc57

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-e01050-6896bdcc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e01050: serviceaccount "payload-processing-e2e-api-a-e01050" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-e01050-69565475c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-e01050-69565475c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-e01050: serviceaccount "payload-processing-e2e-api-a-e01050" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-api-b-e9388b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-e9388b

openshift-ingress

replicaset-controller

e2e-api-b-e9388b-openshift-default-69655f4d64

SuccessfulCreate

Created pod: e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

openshift-ingress

deployment-controller

e2e-api-b-e9388b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-e9388b-openshift-default-69655f4d64 from 0 to 1

openshift-ingress

multus

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e9388b-b7c99946c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-e9388b-b7c99946c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e9388b: serviceaccount "payload-processing-e2e-api-b-e9388b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-e9388b-b7c99946c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-e9388b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-e9388b-b7c99946c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-e9388b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-e9388b-7c99d75d46 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-e9388b: serviceaccount "payload-processing-e2e-api-b-e9388b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-93827d-7ff5557fbb-lbszk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-93827d-d6d7cb69c-m4ztv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-worker-w4-93827d-openshift-default-6c5bbfcf98-7nrxb

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-e01050-6896bdcc57-5fd9d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-e01050-69565475c8-fdh98

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

ProbeError

Startup probe error: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Unhealthy

Startup probe failed: Get "http://10.132.0.92:15021/healthz/ready": dial tcp 10.132.0.92:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-e01050-openshift-default-74cdc89bdb-hp8nh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-e9388b-b7c99946c-tgqfb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-e9388b-7c99d75d46-jtfhl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-e9388b-openshift-default-69655f4d64-8zwxw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-526b97-7bf5747d47-r2mpw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-526b97-7486448b6b-hnk46

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-526b97

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-526b97: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-526b97": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-526b97, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6a4d4af6-0b41-4acc-aa60-bf68ff5512e9, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-526b97-openshift-default-7dfbd688d-mvfjm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-216d39-59959cc765-wkjlv

Unhealthy

Readiness probe failed: dial tcp 10.134.0.75:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-216d39-6d4d494cd-f622c

Unhealthy

Readiness probe failed: dial tcp 10.134.0.74:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-216d39-openshift-default-5897964574-n6bst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3ab8a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3ab8a5

openshift-ingress

replicaset-controller

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd

SuccessfulCreate

Created pod: e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

openshift-ingress

deployment-controller

e2e-ipp-a-3ab8a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd from 0 to 1

openshift-ingress

multus

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

AddedInterface

Add eth0 [10.134.0.91/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3ab8a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3ab8a5: serviceaccount "payload-processing-e2e-ipp-a-3ab8a5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3ab8a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3ab8a5: serviceaccount "payload-processing-e2e-ipp-a-3ab8a5" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

AddedInterface

Add eth0 [10.134.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

AddedInterface

Add eth0 [10.134.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

ProbeError

Readiness probe error: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Unhealthy

Readiness probe failed: Get "http://10.134.0.91:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Unhealthy

Startup probe failed: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

ProbeError

Startup probe error: Get "http://10.134.0.91:15021/healthz/ready": dial tcp 10.134.0.91:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-7ed186

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-7ed186

openshift-ingress

replicaset-controller

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb

SuccessfulCreate

Created pod: e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

openshift-ingress

deployment-controller

e2e-ipp-b-7ed186-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb from 0 to 1

openshift-ingress

multus

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-7ed186

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-7ed186-765f59c65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-7ed186

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7ed186: serviceaccount "payload-processing-e2e-ipp-b-7ed186" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7ed186-765f59c65

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-7ed186-765f59c65

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-7ed186-765f59c65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-7ed186: serviceaccount "payload-processing-e2e-ipp-b-7ed186" not found

openshift-ingress

multus

payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9

AddedInterface

Add eth0 [10.134.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

Unhealthy

Startup probe failed: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

ProbeError

Startup probe error: Get "http://10.132.0.101:15021/healthz/ready": dial tcp 10.132.0.101:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b58948-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b58948-openshift-default-7c696896cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b58948

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b58948

openshift-ingress

multus

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b58948

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b58948-58947dfd79 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b58948: serviceaccount "payload-processing-e2e-ipp-cleanup-b58948" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b58948: serviceaccount "payload-processing-e2e-ipp-cleanup-b58948" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

AddedInterface

Add eth0 [10.134.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b58948

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b58948-79fbf4f7d6-96bkn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b58948-58947dfd79-z7nbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-b58948-openshift-default-7c696896cb-ttw2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3ab8a5-656fccc874-gq8hx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3ab8a5-88fccfcf7-96nsp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-3ab8a5-openshift-default-6d6b5486cd-vbv4x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-7ed186-6596bd9ff8-jd7tp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-7ed186-765f59c65-wp8v9

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-7ed186

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-7ed186: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-7ed186": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-7ed186, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cd4a9610-28de-45a5-9478-4b77f34d27df, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-7ed186-openshift-default-58dd8f6cdb-tjqsl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-ae54af-5cc95698b7-w4fhd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-ae54af-6b864dd554-7kk9c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-ae54af-openshift-default-6c9677b66d-2t6wp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-980661-77765769cc-rvgpd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-980661-68db9c5866-5hkmc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-980661-openshift-default-59bff6f966-l5fhn

Killing

Stopping container istio-proxy