Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f to ip-10-0-141-45.ec2.internal

openshift-ingress

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Scheduled

Successfully assigned openshift-ingress/e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2 to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw to ip-10-0-141-45.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-96pjh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-96pjh to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j to ip-10-0-139-88.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bfxb7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bfxb7 to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Scheduled

Successfully assigned openshift-ingress/e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7 to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-bsmwj

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-bsmwj to ip-10-0-139-88.ec2.internal

openshift-ingress

payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8 to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx to ip-10-0-128-201.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8 to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-37182a-openshift-default-77c66888d-qr5th to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89 to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956 to ip-10-0-139-88.ec2.internal

openshift-ingress

kube-auth-proxy-576b4b4bb7-8g9g5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-576b4b4bb7-8g9g5 to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4 to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r to ip-10-0-139-88.ec2.internal

openshift-ingress

router-default-889c88f7b-28lxw

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-noten-26d968-openshift-default-845977b986-v5hcg

Scheduled

Successfully assigned openshift-ingress/e2e-noten-26d968-openshift-default-845977b986-v5hcg to ip-10-0-139-88.ec2.internal

openshift-ingress

kube-auth-proxy-576b4b4bb7-v29kw

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-576b4b4bb7-v29kw to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6 to ip-10-0-141-45.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jtsp7 to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n to ip-10-0-139-88.ec2.internal

openshift-ingress

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8 to ip-10-0-139-88.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-k5dpp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-k5dpp to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9 to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx to ip-10-0-139-88.ec2.internal

openshift-ingress

router-default-889c88f7b-28lxw

Scheduled

Successfully assigned openshift-ingress/router-default-889c88f7b-28lxw to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp to ip-10-0-139-88.ec2.internal

openshift-ingress

payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9 to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2 to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4 to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp to ip-10-0-128-201.ec2.internal

openshift-ingress

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

Scheduled

Successfully assigned openshift-ingress/e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-mt-27f26465-746677745-2v7cg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-27f26465-746677745-2v7cg to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx to ip-10-0-141-45.ec2.internal

openshift-ingress

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk to ip-10-0-139-88.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7 to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2 to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6 to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp to ip-10-0-141-45.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s to ip-10-0-128-201.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt to ip-10-0-141-45.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-889c88f7b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-889c88f7b

FailedCreate

Error creating: pods "router-default-889c88f7b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-889c88f7b

FailedCreate

Error creating: pods "router-default-889c88f7b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-889c88f7b

SuccessfulCreate

Created pod: router-default-889c88f7b-28lxw
(x6)

openshift-ingress

kubelet

router-default-889c88f7b-28lxw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-889c88f7b-28lxw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-889c88f7b-28lxw

Started

Started container router

openshift-ingress

kubelet

router-default-889c88f7b-28lxw

Created

Created container: router

openshift-ingress

kubelet

router-default-889c88f7b-28lxw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-889c88f7b-28lxw

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-576b4b4bb7

SuccessfulCreate

Created pod: kube-auth-proxy-576b4b4bb7-v29kw

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-v29kw

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-576b4b4bb7 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-576b4b4bb7

SuccessfulCreate

Created pod: kube-auth-proxy-576b4b4bb7-8g9g5
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-576b4b4bb7

FailedCreate

Error creating: pods "kube-auth-proxy-576b4b4bb7-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-8g9g5

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-576b4b4bb7-8g9g5

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-576b4b4bb7-v29kw

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-8g9g5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-v29kw

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bfxb7

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bfxb7

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-8g9g5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.873s (2.873s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-8g9g5

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-8g9g5

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-v29kw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.796s (2.797s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-v29kw

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-576b4b4bb7-v29kw

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.535s (3.535s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-96pjh

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-96pjh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-96pjh

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-97vdx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 11.793s (11.793s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-96pjh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.331s (3.331s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-96pjh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-96pjh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bfxb7

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

ProbeError

Readiness probe error: Get "http://10.134.0.24:8080/ready": dial tcp 10.134.0.24:8080: connect: connection refused body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bfxb7

Unhealthy

Readiness probe failed: Get "http://10.134.0.24:8080/ready": dial tcp 10.134.0.24:8080: connect: connection refused
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-jtsp7

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 8.135s (8.135s including waiting). Image size: 181318953 bytes.
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-bsmwj

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-k5dpp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsmwj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-bsmwj

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-k5dpp

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k5dpp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsmwj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.103s (2.103s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k5dpp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k5dpp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-k5dpp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.23s (2.23s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsmwj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-bsmwj

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jtsp7

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-27dad9-openshift-default-5f5c684bbd

SuccessfulCreate

Created pod: e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-7e2add

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-7e2add

openshift-ingress

gateway_labeler_controller

e2e-inf-a-27dad9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-27dad9

openshift-ingress

deployment-controller

e2e-inf-a-27dad9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-27dad9-openshift-default-5f5c684bbd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-95d6c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-95d6c2

openshift-ingress

replicaset-controller

e2e-worker-w4-7e2add-openshift-default-66c4746c9d

SuccessfulCreate

Created pod: e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

openshift-ingress

replicaset-controller

e2e-worker-w0-95d6c2-openshift-default-64b748c86b

SuccessfulCreate

Created pod: e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

openshift-ingress

multus

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w0-95d6c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-95d6c2-openshift-default-64b748c86b from 0 to 1

openshift-ingress

multus

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-7e2add-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-7e2add-openshift-default-66c4746c9d from 0 to 1

openshift-ingress

multus

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-7e2add

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7e2add: serviceaccount "payload-processing-e2e-worker-w4-7e2add" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-7e2add

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-7e2add: serviceaccount "payload-processing-e2e-worker-w4-7e2add" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-95d6c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-95d6c2: serviceaccount "payload-processing-e2e-worker-w0-95d6c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-95d6c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-95d6c2-59669fbcbf from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-95d6c2: serviceaccount "payload-processing-e2e-worker-w0-95d6c2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-27dad9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-27dad9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-27dad9-5ddc58488c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-27dad9-5ddc58488c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-27dad9-5ddc58488c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-27dad9-5ddc58488c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-27dad9: serviceaccount "payload-processing-e2e-inf-a-27dad9" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-27dad9: serviceaccount "payload-processing-e2e-inf-a-27dad9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

openshift-ingress

gateway_labeler_controller

e2e-ait-f823e45b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f823e45b

openshift-ingress

deployment-controller

e2e-ait-f823e45b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f823e45b-openshift-default-85c6b9c84b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-autores-7d5ec8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-7d5ec8-openshift-default-78b785c986 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-7d5ec8-openshift-default-78b785c986

SuccessfulCreate

Created pod: e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

openshift-ingress

gateway_labeler_controller

e2e-autores-7d5ec8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-7d5ec8

openshift-ingress

kubelet

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

e2e-ait-f823e45b-openshift-default-85c6b9c84b

SuccessfulCreate

Created pod: e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

openshift-ingress

multus

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.314s (1.314s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

Started

Started container payload-processing

openshift-ingress

multus

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-7d5ec8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-7d5ec8-694b66b5d9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-7d5ec8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7d5ec8-694b66b5d9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7d5ec8: serviceaccount "payload-processing-e2e-autores-7d5ec8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-7d5ec8-694b66b5d9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-7d5ec8-694b66b5d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-7d5ec8: serviceaccount "payload-processing-e2e-autores-7d5ec8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f823e45b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f823e45b-795d4976bf from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-37182a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-37182a
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f823e45b: serviceaccount "payload-processing-e2e-ait-f823e45b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f823e45b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f823e45b-b5bc654bb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-37182a-openshift-default-77c66888d

SuccessfulCreate

Created pod: e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f823e45b-795d4976bf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f823e45b-795d4976bf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f823e45b-795d4976bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f823e45b: serviceaccount "payload-processing-e2e-ait-f823e45b" not found

openshift-ingress

deployment-controller

e2e-inf-b-37182a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-37182a-openshift-default-77c66888d from 0 to 1

openshift-ingress

multus

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-37182a-c7cf85cc9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-37182a-c7cf85cc9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-37182a-c7cf85cc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-37182a: serviceaccount "payload-processing-e2e-inf-b-37182a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-37182a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-37182a-c7cf85cc9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-37182a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-37182a-78f888b798 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-37182a-78f888b798

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-37182a-78f888b798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-37182a: serviceaccount "payload-processing-e2e-inf-b-37182a" not found
(x5)

openshift-ingress

kubelet

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-37182a-78f888b798

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

openshift-ingress

multus

payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj

Started

Started container payload-processing
(x6)

openshift-ingress

kubelet

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-f823e45b-openshift-default-85c6b9c84b-fgdx7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f823e45b-b5bc654bb-dfnp9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f823e45b-795d4976bf-dfxtx

Killing

Stopping container payload-processing

openshift-ingress

multus

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848

SuccessfulCreate

Created pod: e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

openshift-ingress

deployment-controller

e2e-migrate-0cd94651-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-0cd94651-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0cd94651-gw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0cd94651: serviceaccount "payload-processing-e2e-migrate-0cd94651" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0cd94651

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0cd94651-66c6c66b46 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0cd94651-66c6c66b46

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0cd94651-66c6c66b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0cd94651: serviceaccount "payload-processing-e2e-migrate-0cd94651" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0cd94651

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0cd94651-66c6c66b46

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cd94651-9f7477bf4-szxf7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cd94651-66c6c66b46-tqkmv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-0cd94651-gw-openshift-default-bd7fc5848-lkp2v

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-6f399ea1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-6f399ea1

openshift-ingress

replicaset-controller

e2e-ait-6f399ea1-openshift-default-5f8c89595b

SuccessfulCreate

Created pod: e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

openshift-ingress

multus

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-6f399ea1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-6f399ea1-openshift-default-5f8c89595b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6f399ea1: serviceaccount "payload-processing-e2e-ait-6f399ea1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-6f399ea1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ait-6f399ea1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-6f399ea1-6b8d985759 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6f399ea1-6b8d985759

SuccessfulCreate

Created pod: payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

openshift-ingress

multus

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-6f399ea1-6b8d985759

FailedCreate

Error creating: pods "payload-processing-e2e-ait-6f399ea1-6b8d985759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-6f399ea1: serviceaccount "payload-processing-e2e-ait-6f399ea1" not found
(x2)

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-6f399ea1-6b8d985759-wkmj8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-6f399ea1-5b86d99bbb-n9fqb

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-2c9db036

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-2c9db036

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-2c9db036-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-2c9db036-openshift-default-6dbd444c7b from 0 to 1

openshift-ingress

multus

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-2c9db036-openshift-default-6dbd444c7b

SuccessfulCreate

Created pod: e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-6f399ea1-openshift-default-5f8c89595b-p9wff

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-derive-2c9db036

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-2c9db036-849f7b8f57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2c9db036-849f7b8f57

FailedCreate

Error creating: pods "payload-processing-e2e-derive-2c9db036-849f7b8f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2c9db036: serviceaccount "payload-processing-e2e-derive-2c9db036" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-2c9db036-849f7b8f57

SuccessfulCreate

Created pod: payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-2c9db036

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-2c9db036-866d5dcf74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-2c9db036: serviceaccount "payload-processing-e2e-derive-2c9db036" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-autores-7d5ec8-694b66b5d9-48c7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-7d5ec8-dc5cdcc46-4rvkr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-2c9db036-866d5dcf74-hfsgh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-2c9db036-849f7b8f57-p8vfg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-2c9db036-openshift-default-6dbd444c7b-rg48q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-7d5ec8-openshift-default-78b785c986-bvrzg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-0aea78-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-0aea78-openshift-default-556dd955b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-0aea78-openshift-default-556dd955b8

SuccessfulCreate

Created pod: e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

openshift-ingress

gateway_labeler_controller

e2e-explicit-0aea78

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-0aea78

openshift-ingress

multus

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-0aea78

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-0aea78-69d7c5bc7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0aea78: serviceaccount "payload-processing-e2e-explicit-0aea78" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-0aea78

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-0aea78-6c7f78999d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0aea78-69d7c5bc7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-0aea78-69d7c5bc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0aea78: serviceaccount "payload-processing-e2e-explicit-0aea78" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0aea78-69d7c5bc7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-27f26465

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-27f26465

openshift-ingress

deployment-controller

e2e-mt-27f26465-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-27f26465-openshift-default-5c78f6bff6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-27f26465-openshift-default-5c78f6bff6

SuccessfulCreate

Created pod: e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

openshift-ingress

multus

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-27f26465

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-27f26465-746677745 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-27f26465

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-27f26465-56b8694dbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-27f26465-746677745

FailedCreate

Error creating: pods "payload-processing-e2e-mt-27f26465-746677745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-27f26465: serviceaccount "payload-processing-e2e-mt-27f26465" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-27f26465-56b8694dbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-27f26465-56b8694dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-27f26465: serviceaccount "payload-processing-e2e-mt-27f26465" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-27f26465-56b8694dbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

openshift-ingress

kubelet

payload-processing-e2e-mt-27f26465-746677745-2v7cg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-27f26465-746677745

SuccessfulCreate

Created pod: payload-processing-e2e-mt-27f26465-746677745-2v7cg

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-27f26465-746677745-2v7cg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-27f26465-746677745-2v7cg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-27f26465-746677745-2v7cg

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-27f26465-56b8694dbb-r74tw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-27f26465-746677745-2v7cg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-27f26465

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-27f26465: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-27f26465": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-27f26465, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2b61013e-6c9b-4b68-a8bf-115678ea24b6, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-explicit-0aea78-69d7c5bc7-tjqm4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0aea78-6c7f78999d-pts7f

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-0aea78

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-0aea78: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-0aea78": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-0aea78, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2275337a-4c2b-4897-a58c-e785525ca53e, UID in object meta:

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-27f26465-openshift-default-5c78f6bff6-sqbm8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-0aea78-openshift-default-556dd955b8-l8n89

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-26d968

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-26d968

openshift-ingress

deployment-controller

e2e-noten-26d968-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-26d968-openshift-default-845977b986 from 0 to 1

openshift-ingress

multus

e2e-noten-26d968-openshift-default-845977b986-v5hcg

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-26d968-openshift-default-845977b986-v5hcg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-26d968-openshift-default-845977b986-v5hcg

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-26d968-openshift-default-845977b986-v5hcg

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-26d968-openshift-default-845977b986

SuccessfulCreate

Created pod: e2e-noten-26d968-openshift-default-845977b986-v5hcg

openshift-ingress

replicaset-controller

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868

SuccessfulCreate

Created pod: e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-5ef59c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-5ef59c

openshift-ingress

multus

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-5ef59c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-5ef59c-openshift-default-6d87659868 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5ef59c: serviceaccount "payload-processing-e2e-shared-a-w2-5ef59c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-5ef59c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-5ef59c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-5ef59c-65995898f5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-5ef59c: serviceaccount "payload-processing-e2e-shared-a-w2-5ef59c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-38f772

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-38f772

openshift-ingress

deployment-controller

e2e-shared-b-w2-38f772-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-38f772-openshift-default-66f66df8c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8

SuccessfulCreate

Created pod: e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-38f772: serviceaccount "payload-processing-e2e-shared-b-w2-38f772" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-38f772: serviceaccount "payload-processing-e2e-shared-b-w2-38f772" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-38f772

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-38f772

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-27dad9-5ddc58488c-2csqt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-27dad9-75f465f7d6-7mvfn

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-27dad9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-27dad9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-27dad9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-27dad9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e50a20e9-a3ef-4cab-abc8-27d525267c81, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-27dad9-openshift-default-5f5c684bbd-zjmcq

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-mt-92d3298e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-92d3298e

openshift-ingress

deployment-controller

e2e-mt-92d3298e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-92d3298e-openshift-default-78b4fd7c9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-92d3298e-openshift-default-78b4fd7c9b

SuccessfulCreate

Created pod: e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

multus

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-37182a-78f888b798-v7mjq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

openshift-ingress

kubelet

payload-processing-e2e-inf-b-37182a-c7cf85cc9-97cnj

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-92d3298e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-92d3298e-5c5cbd657c from 0 to 1

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-37182a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-37182a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-37182a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-37182a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7db380a7-7ed6-49b3-9e0b-f297fd318027, UID in object meta:

openshift-ingress

multus

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-92d3298e-5c5cbd657c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-92d3298e-5c5cbd657c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-92d3298e-5c5cbd657c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-92d3298e: serviceaccount "payload-processing-e2e-mt-92d3298e" not found

openshift-ingress

multus

payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-92d3298e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-92d3298e-67d5764c4b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-92d3298e: serviceaccount "payload-processing-e2e-mt-92d3298e" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": read tcp 10.134.0.2:49908->10.134.0.67:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": read tcp 10.134.0.2:49908->10.134.0.67:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d09c96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d09c96

openshift-ingress

deployment-controller

e2e-shared-a-w3-d09c96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8

SuccessfulCreate

Created pod: e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

openshift-ingress

multus

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-37182a-openshift-default-77c66888d-qr5th

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d09c96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d09c96-689bf87b69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d09c96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d09c96: serviceaccount "payload-processing-e2e-shared-a-w3-d09c96" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d09c96: serviceaccount "payload-processing-e2e-shared-a-w3-d09c96" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-26d968-openshift-default-845977b986-v5hcg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-26d968-openshift-default-845977b986-v5hcg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-26d968-openshift-default-845977b986-v5hcg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-shared-b-w3-966527-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-966527-openshift-default-6b766d4c9b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-966527

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-966527

openshift-ingress

replicaset-controller

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b

SuccessfulCreate

Created pod: e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-966527

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-966527: serviceaccount "payload-processing-e2e-shared-b-w3-966527" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-966527: serviceaccount "payload-processing-e2e-shared-b-w3-966527" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-966527

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-92d3298e-67d5764c4b-vp95c

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-92d3298e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-92d3298e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-92d3298e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-92d3298e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: af03f54f-78b4-4ab7-ae69-bae61b3b6af2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-92d3298e-5c5cbd657c-sljhp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-92d3298e-openshift-default-78b4fd7c9b-7bptn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-fe6196

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-fe6196

openshift-ingress

deployment-controller

e2e-api-a-fe6196-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-fe6196-openshift-default-7f6b8b869d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-fe6196-openshift-default-7f6b8b869d

SuccessfulCreate

Created pod: e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fe6196-79ff746c7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-fe6196-79ff746c7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-fe6196-79ff746c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fe6196: serviceaccount "payload-processing-e2e-api-a-fe6196" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-fe6196: serviceaccount "payload-processing-e2e-api-a-fe6196" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-fe6196

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-fe6196-79ff746c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-fe6196

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-fe6196-84849bfbfd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

openshift-ingress

multus

payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-2715d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-2715d7

openshift-ingress

deployment-controller

e2e-api-b-2715d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-2715d7-openshift-default-656bd5d6cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-2715d7-openshift-default-656bd5d6cd

SuccessfulCreate

Created pod: e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

openshift-ingress

multus

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-2715d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-2715d7-76df7b8d57 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-2715d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-2715d7-5d6489d854 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2715d7-76df7b8d57

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-2715d7-76df7b8d57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2715d7: serviceaccount "payload-processing-e2e-api-b-2715d7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-2715d7-76df7b8d57

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2715d7-5d6489d854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-2715d7-5d6489d854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-2715d7: serviceaccount "payload-processing-e2e-api-b-2715d7" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-2715d7-5d6489d854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

openshift-ingress

kubelet

payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-95d6c2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-95d6c2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-95d6c2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-95d6c2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8d523c4f-c31a-40a4-91c2-b6d72e328154, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-95d6c2-59669fbcbf-trvpp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-95d6c2-76b579d66-hwq8s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-95d6c2-openshift-default-64b748c86b-5qpnk

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-fe6196-84849bfbfd-p49cg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-fe6196-79ff746c7-l9mx8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-fe6196-openshift-default-7f6b8b869d-qzs8n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-2715d7-76df7b8d57-mt4dn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-2715d7-5d6489d854-ptjvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-7e2add-7fb4c5c9d9-fdq9t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-7e2add-56bb4bd4db-jchml

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-2715d7-openshift-default-656bd5d6cd-fzc6r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-7e2add-openshift-default-66c4746c9d-g7mqw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-5ef59c-65995898f5-mmnl4

Unhealthy

Readiness probe failed: dial tcp 10.132.0.65:9004: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-5ef59c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5ef59c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-5ef59c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-5ef59c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1c7a1c4-8a09-4572-a5b9-87105bceca31, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

Unhealthy

Readiness probe failed: dial tcp 10.132.0.64:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-5ef59c-5c4d489d78-2vkfh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-5ef59c-openshift-default-6d87659868-8jmhk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-38f772-6dfb667fc7-bvzw2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-38f772-5f578874fd-sgcx6

Unhealthy

Readiness probe failed: dial tcp 10.132.0.67:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-b-w2-38f772-openshift-default-66f66df8c8-kclk2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-6fe4c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b

SuccessfulCreate

Created pod: e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-6fe4c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-6fe4c2

openshift-ingress

multus

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-6fe4c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-6fe4c2-687645997c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-6fe4c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6fe4c2: serviceaccount "payload-processing-e2e-ipp-a-6fe4c2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6fe4c2-687645997c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

openshift-ingress

multus

payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-6fe4c2-687645997c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-6fe4c2-687645997c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-6fe4c2: serviceaccount "payload-processing-e2e-ipp-a-6fe4c2" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Unhealthy

Readiness probe failed: Get "http://10.134.0.78:15021/healthz/ready": read tcp 10.134.0.2:45224->10.134.0.78:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

ProbeError

Readiness probe error: Get "http://10.134.0.78:15021/healthz/ready": read tcp 10.134.0.2:45224->10.134.0.78:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-dbaf52-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-dbaf52-openshift-default-6f79688f7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b

SuccessfulCreate

Created pod: e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-dbaf52

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-dbaf52

openshift-ingress

multus

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-dbaf52

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dbaf52-6749f5c495

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-dbaf52-6749f5c495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dbaf52: serviceaccount "payload-processing-e2e-ipp-b-dbaf52" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-dbaf52-6749f5c495

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-dbaf52: serviceaccount "payload-processing-e2e-ipp-b-dbaf52" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-dbaf52

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-dbaf52-6749f5c495 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

ProbeError

Startup probe error: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Unhealthy

Startup probe failed: Get "http://10.134.0.79:15021/healthz/ready": dial tcp 10.134.0.79:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-cleanup-1688a8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-1688a8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-1688a8

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76

SuccessfulCreate

Created pod: e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

openshift-ingress

multus

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1688a8: serviceaccount "payload-processing-e2e-ipp-cleanup-1688a8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-1688a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-1688a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-1688a8: serviceaccount "payload-processing-e2e-ipp-cleanup-1688a8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

AddedInterface

Add eth0 [10.133.0.97/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

ProbeError

Startup probe error: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

Unhealthy

Startup probe failed: Get "http://10.134.0.80:15021/healthz/ready": dial tcp 10.134.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-1688a8-54dd58b47f-djhlw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-1688a8-6bddc5d8f8-ljmfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-1688a8-openshift-default-6b5bd94c76-tmsrx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-6fe4c2-687645997c-lztbl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-6fe4c2-78c48d7b4b-zzgmq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-6fe4c2-openshift-default-d69d4fb4b-6f956

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-dbaf52-f4544494b-zphnm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-dbaf52-6749f5c495-lkxfr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-dbaf52-openshift-default-6f79688f7b-8rhkp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d09c96-689bf87b69-h6jnw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d09c96-7f59c6bf54-7tjx2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-d09c96-openshift-default-7f5bf5ffc8-b4j5j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-966527-57dfb5dcc9-tdhs9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-966527-8ccfd888b-wgzvp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-966527

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-966527: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-966527": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-966527, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b2be9970-2b3f-42b7-92e9-10c2bed2bb5b, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-966527-openshift-default-6b766d4c9b-66hx6

Killing

Stopping container istio-proxy