Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm to ip-10-0-129-234.ec2.internal

openshift-ingress

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67 to ip-10-0-136-225.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-zc2wh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zc2wh to ip-10-0-136-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2 to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7 to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

Scheduled

Successfully assigned openshift-ingress/e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn to ip-10-0-131-221.ec2.internal

openshift-ingress

kube-auth-proxy-7c5fc7c97f-f7z25

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c5fc7c97f-f7z25 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9 to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv to ip-10-0-129-234.ec2.internal

openshift-ingress

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959 to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn to ip-10-0-129-234.ec2.internal

openshift-ingress

kube-auth-proxy-7c5fc7c97f-kdwxp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c5fc7c97f-kdwxp to ip-10-0-136-225.ec2.internal

openshift-ingress

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb to ip-10-0-129-234.ec2.internal

openshift-ingress

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg to ip-10-0-129-234.ec2.internal

openshift-ingress

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2 to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd to ip-10-0-136-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45 to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg to ip-10-0-131-221.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-8lgh8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-8lgh8 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62 to ip-10-0-129-234.ec2.internal

openshift-ingress

router-default-6b7d894bd-qg4wn

Scheduled

Successfully assigned openshift-ingress/router-default-6b7d894bd-qg4wn to ip-10-0-136-225.ec2.internal

openshift-ingress

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt to ip-10-0-129-234.ec2.internal

openshift-ingress

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6 to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj to ip-10-0-131-221.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-knht6

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-knht6 to ip-10-0-136-225.ec2.internal

openshift-ingress

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

Scheduled

Successfully assigned openshift-ingress/e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc to ip-10-0-129-234.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9 to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-6tc8t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-6tc8t to ip-10-0-136-225.ec2.internal

openshift-ingress

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv to ip-10-0-131-221.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk to ip-10-0-129-234.ec2.internal

openshift-ingress

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

Scheduled

Successfully assigned openshift-ingress/e2e-derive-cc741da4-openshift-default-7f57475948-48fvs to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-hwhcb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-hwhcb to ip-10-0-136-225.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-808e44-964c9b4df-bngfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-808e44-964c9b4df-bngfr to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9 to ip-10-0-131-221.ec2.internal

openshift-ingress

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc to ip-10-0-129-234.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw to ip-10-0-131-221.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6b7d894bd from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-6b7d894bd

FailedCreate

Error creating: pods "router-default-6b7d894bd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6b7d894bd

FailedCreate

Error creating: pods "router-default-6b7d894bd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6b7d894bd

SuccessfulCreate

Created pod: router-default-6b7d894bd-qg4wn
(x6)

openshift-ingress

kubelet

router-default-6b7d894bd-qg4wn

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6b7d894bd-qg4wn

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-6b7d894bd-qg4wn

Started

Started container router

openshift-ingress

kubelet

router-default-6b7d894bd-qg4wn

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eaa467bc105be2f7695ecfea0f0c53f4c5cd52f1f705da378c7a33d13f1d102f" already present on machine

openshift-ingress

kubelet

router-default-6b7d894bd-qg4wn

Created

Created container: router

openshift-ingress

multus

router-default-6b7d894bd-qg4wn

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7c5fc7c97f-kdwxp

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7c5fc7c97f from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7c5fc7c97f

SuccessfulCreate

Created pod: kube-auth-proxy-7c5fc7c97f-f7z25

openshift-ingress

replicaset-controller

kube-auth-proxy-7c5fc7c97f

SuccessfulCreate

Created pod: kube-auth-proxy-7c5fc7c97f-kdwxp

openshift-ingress

replicaset-controller

kube-auth-proxy-7c5fc7c97f

FailedCreate

Error creating: pods "kube-auth-proxy-7c5fc7c97f-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-kdwxp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-f7z25

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7c5fc7c97f-f7z25

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-zc2wh

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-kdwxp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.106s (3.106s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-f7z25

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.002s (3.002s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-kdwxp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-kdwxp

Created

Created container: kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-zc2wh

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-f7z25

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c5fc7c97f-f7z25

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.704s (2.704s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.745s (2.745s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-xk9c4

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-8lgh8

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-8lgh8

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8lgh8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8lgh8

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8lgh8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.52s (2.52s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-8lgh8

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-zc2wh

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-zc2wh
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-knht6

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-knht6

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.551s (2.551s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-6tc8t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-hwhcb

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6tc8t

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-hwhcb

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-6tc8t

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hwhcb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hwhcb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6tc8t

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.253s (2.253s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6tc8t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hwhcb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.182s (2.182s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-6tc8t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hwhcb

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-knht6

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w5-5be8a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w5-5be8a3-openshift-default-76c5869c6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-34aeca-openshift-default-74bc449fb4

SuccessfulCreate

Created pod: e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

openshift-ingress

gateway_labeler_controller

e2e-worker-w5-5be8a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w5-5be8a3

openshift-ingress

gateway_labeler_controller

e2e-inf-a-34aeca

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-34aeca

openshift-ingress

replicaset-controller

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b

SuccessfulCreate

Created pod: e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

openshift-ingress

deployment-controller

e2e-inf-a-34aeca-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-34aeca-openshift-default-74bc449fb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-951469

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-951469

openshift-ingress

deployment-controller

e2e-worker-w0-951469-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-951469-openshift-default-5dd5757f76 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-951469-openshift-default-5dd5757f76

SuccessfulCreate

Created pod: e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

openshift-ingress

multus

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-34aeca: serviceaccount "payload-processing-e2e-inf-a-34aeca" not found

openshift-ingress

multus

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-34aeca

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-34aeca

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-34aeca: serviceaccount "payload-processing-e2e-inf-a-34aeca" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-951469: serviceaccount "payload-processing-e2e-worker-w0-951469" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-951469

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-951469-754859f7dc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-951469-754859f7dc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-951469

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-951469-754859f7dc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-951469-754859f7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-951469: serviceaccount "payload-processing-e2e-worker-w0-951469" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-5be8a3: serviceaccount "payload-processing-e2e-worker-w5-5be8a3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w5-5be8a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w5-5be8a3-758f8bb47c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w5-5be8a3: serviceaccount "payload-processing-e2e-worker-w5-5be8a3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w5-5be8a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.42s (3.42s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.1s (1.1s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.991s (1.991s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-a304aa20-openshift-default-587d4d7b44

SuccessfulCreate

Created pod: e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-ait-a304aa20-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a304aa20-openshift-default-587d4d7b44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a304aa20

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a304aa20

openshift-ingress

multus

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.002s (2.002s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-b7292e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-b7292e

openshift-ingress

replicaset-controller

e2e-autores-b7292e-openshift-default-5b84f9d48

SuccessfulCreate

Created pod: e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

openshift-ingress

deployment-controller

e2e-autores-b7292e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-b7292e-openshift-default-5b84f9d48 from 0 to 1

openshift-ingress

multus

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a304aa20

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a304aa20-7bf9b76fc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a304aa20-7bf9b76fc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a304aa20: serviceaccount "payload-processing-e2e-ait-a304aa20" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a304aa20-7bf9b76fc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a304aa20

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a304aa20-7bf9b76fc5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a304aa20: serviceaccount "payload-processing-e2e-ait-a304aa20" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

e2e-inf-b-021eb8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-021eb8-openshift-default-5965d6499b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-021eb8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-021eb8

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-inf-b-021eb8-openshift-default-5965d6499b

SuccessfulCreate

Created pod: e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b7292e-5558798d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-autores-b7292e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-b7292e-5fd7855579 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b7292e-5fd7855579

SuccessfulCreate

Created pod: payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b7292e-5fd7855579

FailedCreate

Error creating: pods "payload-processing-e2e-autores-b7292e-5fd7855579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b7292e: serviceaccount "payload-processing-e2e-autores-b7292e" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-b7292e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-b7292e-5558798d78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b7292e-5558798d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-b7292e-5558798d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b7292e: serviceaccount "payload-processing-e2e-autores-b7292e" not found
(x2)

openshift-ingress

kubelet

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

Created

Created container: istio-proxy

openshift-ingress

multus

payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

ProbeError

Startup probe error: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused body:

openshift-ingress

multus

payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-021eb8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-021eb8-5b985b5bf9 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

Unhealthy

Startup probe failed: Get "http://10.133.0.33:15021/healthz/ready": dial tcp 10.133.0.33:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-021eb8-5b985b5bf9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-021eb8-5b985b5bf9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-021eb8-5b985b5bf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-021eb8: serviceaccount "payload-processing-e2e-inf-b-021eb8" not found
(x5)

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-021eb8: serviceaccount "payload-processing-e2e-inf-b-021eb8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-021eb8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-a304aa20-7bf9b76fc5-2j6hx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a304aa20-6cc7bf966b-gqf9t

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-a304aa20-openshift-default-587d4d7b44-7nzxv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-8178145c-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8178145c-gw-openshift-default-bbbd74756 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-8178145c-gw-openshift-default-bbbd74756

SuccessfulCreate

Created pod: e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

openshift-ingress

gateway_labeler_controller

e2e-migrate-8178145c-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8178145c-gw

openshift-ingress

multus

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

Started

Started container istio-proxy
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8178145c-5b95fb5998

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8178145c-5b95fb5998-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8178145c: serviceaccount "payload-processing-e2e-migrate-8178145c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8178145c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8178145c-58576d8f98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8178145c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8178145c-5b95fb5998 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8178145c-5b95fb5998

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

openshift-ingress

multus

payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8178145c-58576d8f98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8178145c-58576d8f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8178145c: serviceaccount "payload-processing-e2e-migrate-8178145c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8178145c-58576d8f98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62
(x5)

openshift-ingress

kubelet

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

Unhealthy

Startup probe failed: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

ProbeError

Startup probe error: Get "http://10.133.0.39:15021/healthz/ready": dial tcp 10.133.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8178145c-58576d8f98-k6g62

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8178145c-5b95fb5998-jp8zj

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-92246a6e-openshift-default-67c76c746b

SuccessfulCreate

Created pod: e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-migrate-8178145c-gw-openshift-default-dockercfg-m5hd8); attempting to pull the image may not succeed.

openshift-ingress

deployment-controller

e2e-ait-92246a6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-92246a6e-openshift-default-67c76c746b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-92246a6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-92246a6e

openshift-ingress

kubelet

e2e-migrate-8178145c-gw-openshift-default-bbbd74756-ff2tz

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-92246a6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-92246a6e-7987dbf77c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

openshift-ingress

kubelet

payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-92246a6e-7987dbf77c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-92246a6e-7987dbf77c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-92246a6e: serviceaccount "payload-processing-e2e-ait-92246a6e" not found

openshift-ingress

multus

payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-92246a6e-7987dbf77c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-92246a6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-92246a6e: serviceaccount "payload-processing-e2e-ait-92246a6e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-92246a6e-697bcf4cd6-df58j

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-slice-controller

payload-pre-processing-e2e-ait-92246a6e

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-pre-processing-e2e-ait-92246a6e: failed to update payload-pre-processing-e2e-ait-92246a6e-khkjm EndpointSlice for Service openshift-ingress/payload-pre-processing-e2e-ait-92246a6e: endpointslices.discovery.k8s.io "payload-pre-processing-e2e-ait-92246a6e-khkjm" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-92246a6e-7987dbf77c-8khm6

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-cc741da4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-cc741da4

openshift-ingress

deployment-controller

e2e-derive-cc741da4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-cc741da4-openshift-default-7f57475948 from 0 to 1

openshift-ingress

kubelet

e2e-ait-92246a6e-openshift-default-67c76c746b-fw9v7

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-cc741da4-openshift-default-7f57475948

SuccessfulCreate

Created pod: e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

openshift-ingress

multus

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-cc741da4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-cc741da4-8849bfdf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

openshift-ingress

multus

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-cc741da4: serviceaccount "payload-processing-e2e-derive-cc741da4" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-cc741da4-57747f4d89

FailedCreate

Error creating: pods "payload-processing-e2e-derive-cc741da4-57747f4d89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-cc741da4: serviceaccount "payload-processing-e2e-derive-cc741da4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-cc741da4-57747f4d89

SuccessfulCreate

Created pod: payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

openshift-ingress

deployment-controller

payload-processing-e2e-derive-cc741da4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-cc741da4-57747f4d89 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b7292e-5558798d78-g67bt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b7292e-5fd7855579-kpdsc

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-cc741da4-57747f4d89-vqvv9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-cc741da4-8849bfdf4-gjs45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-cc741da4-openshift-default-7f57475948-48fvs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-b7292e-openshift-default-5b84f9d48-dfbhc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-808e44-openshift-default-699c89ff44

SuccessfulCreate

Created pod: e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

openshift-ingress

gateway_labeler_controller

e2e-explicit-808e44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-808e44

openshift-ingress

deployment-controller

e2e-explicit-808e44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-808e44-openshift-default-699c89ff44 from 0 to 1

openshift-ingress

multus

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.449s (3.449s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-808e44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-808e44-74f94c5686 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-808e44-964c9b4df

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-808e44-964c9b4df-bngfr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-808e44-964c9b4df

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-808e44-964c9b4df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-808e44: serviceaccount "payload-processing-e2e-explicit-808e44" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-808e44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-808e44-964c9b4df from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-808e44-74f94c5686

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-808e44-74f94c5686

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-808e44-74f94c5686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-808e44: serviceaccount "payload-processing-e2e-explicit-808e44" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-808e44-964c9b4df-bngfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-808e44-964c9b4df-bngfr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-808e44-964c9b4df-bngfr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-808e44-964c9b4df-bngfr

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-bb3ce27c-openshift-default-99748d596

SuccessfulCreate

Created pod: e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

openshift-ingress

deployment-controller

e2e-mt-bb3ce27c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-bb3ce27c-openshift-default-99748d596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-bb3ce27c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-bb3ce27c

openshift-ingress

multus

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bb3ce27c-6899968df

FailedCreate

Error creating: pods "payload-processing-e2e-mt-bb3ce27c-6899968df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bb3ce27c: serviceaccount "payload-processing-e2e-mt-bb3ce27c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-bb3ce27c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-bb3ce27c-6899968df from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-bb3ce27c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bb3ce27c: serviceaccount "payload-processing-e2e-mt-bb3ce27c" not found

openshift-ingress

multus

payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bb3ce27c-6899968df

SuccessfulCreate

Created pod: payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

openshift-ingress

multus

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-808e44-74f94c5686-hk4hk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-808e44-964c9b4df-bngfr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-808e44

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-808e44: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-808e44": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-808e44, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c71f76f8-b3a5-42af-b96c-448e8555003f, UID in object meta:

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": read tcp 10.133.0.2:39748->10.133.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": read tcp 10.133.0.2:39748->10.133.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-bb3ce27c-6899968df-kzscv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bb3ce27c-bd84c87db-6j4bw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-bb3ce27c-openshift-default-99748d596-mrgdt

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-b2d5da-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b2d5da-openshift-default-6574867646 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b2d5da-openshift-default-6574867646

SuccessfulCreate

Created pod: e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b2d5da

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b2d5da

openshift-ingress

gateway_labeler_controller

e2e-noten-b81e47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-b81e47

openshift-ingress

deployment-controller

e2e-noten-b81e47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-b81e47-openshift-default-7567df9d6b from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-b81e47-openshift-default-7567df9d6b

SuccessfulCreate

Created pod: e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

openshift-ingress

multus

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-808e44-openshift-default-699c89ff44-vlgbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b2d5da

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b2d5da

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b2d5da: serviceaccount "payload-processing-e2e-shared-a-w2-b2d5da" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b2d5da: serviceaccount "payload-processing-e2e-shared-a-w2-b2d5da" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-92b54f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-92b54f

openshift-ingress

replicaset-controller

e2e-shared-b-w2-92b54f-openshift-default-df88d779b

SuccessfulCreate

Created pod: e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

openshift-ingress

deployment-controller

e2e-shared-b-w2-92b54f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-92b54f-openshift-default-df88d779b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-92b54f: serviceaccount "payload-processing-e2e-shared-b-w2-92b54f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-92b54f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-92b54f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-92b54f: serviceaccount "payload-processing-e2e-shared-b-w2-92b54f" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-fa9905fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fa9905fd-openshift-default-66587b7cc6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fa9905fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fa9905fd

openshift-ingress

replicaset-controller

e2e-mt-fa9905fd-openshift-default-66587b7cc6

SuccessfulCreate

Created pod: e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

openshift-ingress

multus

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fa9905fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fa9905fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fa9905fd-596666c4b5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fa9905fd: serviceaccount "payload-processing-e2e-mt-fa9905fd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fa9905fd-596666c4b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fa9905fd-596666c4b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fa9905fd: serviceaccount "payload-processing-e2e-mt-fa9905fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fa9905fd-596666c4b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-34aeca-7dd8c4f7b7-8gqb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-34aeca-66fc765b5d-jltbd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-34aeca-openshift-default-74bc449fb4-9tbzt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-b81e47-openshift-default-7567df9d6b-wwncg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-021eb8-788b4fc4f4-8x25f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-021eb8-5b985b5bf9-wz9fn

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-021eb8-openshift-default-5965d6499b-ztkhb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-537abe-openshift-default-5467898dc8

SuccessfulCreate

Created pod: e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

openshift-ingress

multus

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-537abe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-537abe

openshift-ingress

deployment-controller

e2e-shared-a-w3-537abe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-537abe-openshift-default-5467898dc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-537abe: serviceaccount "payload-processing-e2e-shared-a-w3-537abe" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-537abe: serviceaccount "payload-processing-e2e-shared-a-w3-537abe" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-537abe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-537abe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-c50e10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-c50e10

openshift-ingress

deployment-controller

e2e-shared-b-w3-c50e10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-c50e10-openshift-default-7c564f6846 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846

SuccessfulCreate

Created pod: e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-c50e10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-c50e10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c50e10: serviceaccount "payload-processing-e2e-shared-b-w3-c50e10" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c50e10: serviceaccount "payload-processing-e2e-shared-b-w3-c50e10" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

ProbeError

Readiness probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Unhealthy

Readiness probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-fa9905fd-596666c4b5-hdjpj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fa9905fd-c74dcdc5d-r7pkc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-fa9905fd-openshift-default-66587b7cc6-bbq4j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-bc95f3-openshift-default-7f855964bd

SuccessfulCreate

Created pod: e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

openshift-ingress

deployment-controller

e2e-api-a-bc95f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-bc95f3-openshift-default-7f855964bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-bc95f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-bc95f3

openshift-ingress

multus

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bc95f3-794b866b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-bc95f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-bc95f3-77c4556c55 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bc95f3-77c4556c55

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-bc95f3-77c4556c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bc95f3: serviceaccount "payload-processing-e2e-api-a-bc95f3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-bc95f3-77c4556c55

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-bc95f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-bc95f3-794b866b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-bc95f3-794b866b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-bc95f3-794b866b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-bc95f3: serviceaccount "payload-processing-e2e-api-a-bc95f3" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-api-b-57732b-openshift-default-759dbc7b86

SuccessfulCreate

Created pod: e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

openshift-ingress

gateway_labeler_controller

e2e-api-b-57732b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-57732b

openshift-ingress

deployment-controller

e2e-api-b-57732b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-57732b-openshift-default-759dbc7b86 from 0 to 1

openshift-ingress

multus

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-57732b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-57732b-5bf77956f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-57732b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-57732b-7b4c447bdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-57732b-7b4c447bdf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-57732b-7b4c447bdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-57732b: serviceaccount "payload-processing-e2e-api-b-57732b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-57732b-7b4c447bdf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-57732b-5bf77956f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-57732b-5bf77956f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-57732b-5bf77956f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-57732b: serviceaccount "payload-processing-e2e-api-b-57732b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

ProbeError

Readiness probe error: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Unhealthy

Readiness probe failed: Get "http://10.134.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-bc95f3-794b866b6-r8pwk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-bc95f3-77c4556c55-lkdrx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-bc95f3-openshift-default-7f855964bd-brkk2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-57732b-7b4c447bdf-9nvbm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-57732b-5bf77956f8-kpk8h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-57732b-openshift-default-759dbc7b86-kqp5z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b2d5da-58c5db6457-g4rzl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b2d5da-8d9d76446-5swzl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-951469-5cbfc7c6db-7rrqw

Unhealthy

Readiness probe failed: dial tcp 10.134.0.27:9004: i/o timeout

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-951469-754859f7dc-vvjng

Unhealthy

Readiness probe failed: dial tcp 10.134.0.28:9004: i/o timeout

openshift-ingress

kubelet

e2e-worker-w0-951469-openshift-default-5dd5757f76-crzh9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-b2d5da-openshift-default-6574867646-qxssg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-92b54f-7fc5d8c599-xmhhv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-92b54f-9c4c54fbb-99vf9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-92b54f-openshift-default-df88d779b-qzb8l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w5-5be8a3-65bfc65c74-m2lrn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w5-5be8a3-758f8bb47c-h6s6d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w5-5be8a3-openshift-default-76c5869c6b-kcb67

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-2dd8de-openshift-default-698d8489fb

SuccessfulCreate

Created pod: e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-2dd8de

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-2dd8de

openshift-ingress

deployment-controller

e2e-ipp-a-2dd8de-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-2dd8de-openshift-default-698d8489fb from 0 to 1

openshift-ingress

multus

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2dd8de-648db5f59f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-2dd8de-648db5f59f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2dd8de: serviceaccount "payload-processing-e2e-ipp-a-2dd8de" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-2dd8de: serviceaccount "payload-processing-e2e-ipp-a-2dd8de" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-2dd8de-648db5f59f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-2dd8de

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-2dd8de-648db5f59f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-2dd8de

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f629bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f629bd

openshift-ingress

multus

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-f629bd-openshift-default-77894b9698

SuccessfulCreate

Created pod: e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

openshift-ingress

deployment-controller

e2e-ipp-b-f629bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f629bd-openshift-default-77894b9698 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f629bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f629bd-5559f687cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f629bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f629bd: serviceaccount "payload-processing-e2e-ipp-b-f629bd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f629bd-5559f687cc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f629bd-5559f687cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f629bd: serviceaccount "payload-processing-e2e-ipp-b-f629bd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f629bd-5559f687cc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

Unhealthy

Startup probe failed: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

ProbeError

Startup probe error: Get "http://10.134.0.75:15021/healthz/ready": dial tcp 10.134.0.75:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-eaff22-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-eaff22

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-eaff22

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944

SuccessfulCreate

Created pod: e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

openshift-ingress

multus

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-eaff22

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-eaff22

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eaff22: serviceaccount "payload-processing-e2e-ipp-cleanup-eaff22" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eaff22: serviceaccount "payload-processing-e2e-ipp-cleanup-eaff22" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eaff22-79bcb8d467-6b8d6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eaff22-58c5777c8-6l84p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-eaff22-openshift-default-84dcb59944-lnjb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-2dd8de-648db5f59f-kf7zp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-2dd8de-677dfbdbbb-k5z2q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-2dd8de-openshift-default-698d8489fb-bvc9t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f629bd-5f87cb6c86-wx9gp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f629bd-5559f687cc-9zkql

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-f629bd-openshift-default-77894b9698-jfkkh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-537abe-58fc8ddcd9-2glbp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-537abe-7d9cdfc798-vhdq9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-537abe-openshift-default-5467898dc8-k2959

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c50e10-b9d67bd9c-49rmb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c50e10-566fc47978-d6tgf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-c50e10-openshift-default-7c564f6846-hplp7

Killing

Stopping container istio-proxy