Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-730be9-778974d799-cxwd6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6 to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

Scheduled

Successfully assigned openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9 to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8 to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64 to ip-10-0-140-124.ec2.internal

openshift-ingress

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2 to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-ff390e-58c965479-4kdff

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-gqczn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-gqczn to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt to ip-10-0-141-185.ec2.internal

openshift-ingress

kube-auth-proxy-5d5b88c986-7p5bl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d5b88c986-7p5bl to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c to ip-10-0-134-28.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-ddjq5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ddjq5 to ip-10-0-140-124.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-nkwh5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5 to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk to ip-10-0-134-28.ec2.internal

openshift-ingress

kube-auth-proxy-5d5b88c986-dfz4g

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d5b88c986-dfz4g to ip-10-0-140-124.ec2.internal

openshift-ingress

e2e-noten-981036-openshift-default-69b54f868b-bpnx6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6 to ip-10-0-141-185.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-2t2zf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-2t2zf to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4 to ip-10-0-134-28.ec2.internal

openshift-ingress

router-default-78c4fbf958-wdqdc

Scheduled

Successfully assigned openshift-ingress/router-default-78c4fbf958-wdqdc to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76 to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79 to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0da90685-df45955bf-qspbk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd to ip-10-0-140-124.ec2.internal

openshift-ingress

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Scheduled

Successfully assigned openshift-ingress/e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln to ip-10-0-141-185.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-cxzvg to ip-10-0-134-28.ec2.internal

openshift-ingress

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44 to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd to ip-10-0-134-28.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828 to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh to ip-10-0-141-185.ec2.internal

openshift-ingress

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

Scheduled

Successfully assigned openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn to ip-10-0-140-124.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b to ip-10-0-141-185.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62 to ip-10-0-141-185.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-78c4fbf958 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-78c4fbf958

FailedCreate

Error creating: pods "router-default-78c4fbf958-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-78c4fbf958

FailedCreate

Error creating: pods "router-default-78c4fbf958-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-78c4fbf958

SuccessfulCreate

Created pod: router-default-78c4fbf958-wdqdc
(x6)

openshift-ingress

kubelet

router-default-78c4fbf958-wdqdc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-78c4fbf958-wdqdc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-78c4fbf958-wdqdc

Created

Created container: router

openshift-ingress

kubelet

router-default-78c4fbf958-wdqdc

Started

Started container router

openshift-ingress

kubelet

router-default-78c4fbf958-wdqdc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-78c4fbf958-wdqdc

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5d5b88c986 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-5d5b88c986-dfz4g

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5d5b88c986

SuccessfulCreate

Created pod: kube-auth-proxy-5d5b88c986-dfz4g
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-5d5b88c986

FailedCreate

Error creating: pods "kube-auth-proxy-5d5b88c986-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-5d5b88c986-7p5bl

AddedInterface

Add eth0 [10.132.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-5d5b88c986

SuccessfulCreate

Created pod: kube-auth-proxy-5d5b88c986-7p5bl

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-7p5bl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-dfz4g

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-ddjq5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-ddjq5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-dfz4g

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ddjq5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-7p5bl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-7p5bl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-7p5bl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.784s (2.784s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-dfz4g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.761s (2.761s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d5b88c986-dfz4g

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ddjq5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.387s (2.387s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ddjq5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ddjq5

Started

Started container discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

AddedInterface

Add eth0 [10.134.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxlkds

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.755s (2.755s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-nkwh5

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-nkwh5

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nkwh5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nkwh5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nkwh5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nkwh5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.469s (2.469s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nkwh5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nkwh5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-ddjq5

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-ddjq5

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-cxzvg

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.596s (2.596s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-gqczn

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-2t2zf

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-gqczn

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gqczn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2t2zf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-2t2zf

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gqczn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.285s (1.285s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gqczn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-gqczn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2t2zf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.335s (2.335s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2t2zf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-2t2zf

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-cxzvg

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-a23d9f-openshift-default-5f48866c7b

SuccessfulCreate

Created pod: e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a23d9f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a23d9f

openshift-ingress

replicaset-controller

e2e-worker-w4-890f3e-openshift-default-6844dc9c86

SuccessfulCreate

Created pod: e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-890f3e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-890f3e

openshift-ingress

deployment-controller

e2e-worker-w4-890f3e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-890f3e-openshift-default-6844dc9c86 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-ffb593

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-ffb593

openshift-ingress

deployment-controller

e2e-worker-w0-ffb593-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-ffb593-openshift-default-7b46bf998b from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w0-ffb593-openshift-default-7b46bf998b

SuccessfulCreate

Created pod: e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

openshift-ingress

deployment-controller

e2e-inf-a-a23d9f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a23d9f-openshift-default-5f48866c7b from 0 to 1

openshift-ingress

multus

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

multus

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-ffb593

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-ffb593-79cfbcc885 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-ffb593: serviceaccount "payload-processing-e2e-worker-w0-ffb593" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-ffb593

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-ffb593-79cfbcc885

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-ffb593-79cfbcc885-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-ffb593: serviceaccount "payload-processing-e2e-worker-w0-ffb593" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-890f3e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-890f3e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-890f3e-7bd44bbc89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-ffb593-79cfbcc885

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-890f3e: serviceaccount "payload-processing-e2e-worker-w4-890f3e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-890f3e: serviceaccount "payload-processing-e2e-worker-w4-890f3e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a23d9f: serviceaccount "payload-processing-e2e-inf-a-a23d9f" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a23d9f-5fc5545c47

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a23d9f-5fc5545c47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a23d9f: serviceaccount "payload-processing-e2e-inf-a-a23d9f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a23d9f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a23d9f-5fc5545c47 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a23d9f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

openshift-ingress

multus

payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-ca71c041-openshift-default-54b64bbcbd

SuccessfulCreate

Created pod: e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

openshift-ingress

deployment-controller

e2e-ait-ca71c041-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ca71c041-openshift-default-54b64bbcbd from 0 to 1

openshift-ingress

multus

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-ca71c041

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ca71c041

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a23d9f-5fc5545c47

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-autores-abf07f-openshift-default-796b6f5978

SuccessfulCreate

Created pod: e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

openshift-ingress

deployment-controller

e2e-autores-abf07f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-abf07f-openshift-default-796b6f5978 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-abf07f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-abf07f

openshift-ingress

multus

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ca71c041

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ca71c041

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ca71c041-6f78c5c5c9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ca71c041-6f78c5c5c9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ca71c041-6f78c5c5c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ca71c041: serviceaccount "payload-processing-e2e-ait-ca71c041" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ca71c041-6f78c5c5c9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ca71c041: serviceaccount "payload-processing-e2e-ait-ca71c041" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-abf07f-79d5d794bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-abf07f-5f79db5ff7

SuccessfulCreate

Created pod: payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

openshift-ingress

deployment-controller

payload-processing-e2e-autores-abf07f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-abf07f-5f79db5ff7 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-abf07f-5f79db5ff7

FailedCreate

Error creating: pods "payload-processing-e2e-autores-abf07f-5f79db5ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-abf07f: serviceaccount "payload-processing-e2e-autores-abf07f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-abf07f-79d5d794bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-abf07f-79d5d794bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-abf07f: serviceaccount "payload-processing-e2e-autores-abf07f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-abf07f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-abf07f-79d5d794bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Unhealthy

Startup probe failed: Get "http://10.134.0.24:15021/healthz/ready": dial tcp 10.134.0.24:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

ProbeError

Startup probe error: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

Unhealthy

Startup probe failed: Get "http://10.134.0.23:15021/healthz/ready": dial tcp 10.134.0.23:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

ProbeError

Startup probe error: Get "http://10.134.0.24:15021/healthz/ready": dial tcp 10.134.0.24:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-2430e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-2430e2

openshift-ingress

deployment-controller

e2e-inf-b-2430e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-2430e2-openshift-default-54fd5f9b88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-2430e2-openshift-default-54fd5f9b88

SuccessfulCreate

Created pod: e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

openshift-ingress

multus

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-2430e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2430e2: serviceaccount "payload-processing-e2e-inf-b-2430e2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2430e2-74f94f8779

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-2430e2-74f94f8779-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2430e2: serviceaccount "payload-processing-e2e-inf-b-2430e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2430e2-74f94f8779

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-2430e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-2430e2-74f94f8779 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

openshift-ingress

multus

payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

Started

Started container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ca71c041-b77c5cbfd-hmr64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

Killing

Stopping container istio-proxy
(x3)

openshift-ingress

kubelet

e2e-ait-ca71c041-openshift-default-54b64bbcbd-76wt2

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88

SuccessfulCreate

Created pod: e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

openshift-ingress

deployment-controller

e2e-migrate-0cec7519-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-0cec7519-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0cec7519-gw

openshift-ingress

multus

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Unhealthy

Readiness probe failed: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

ProbeError

Readiness probe error: Get "http://10.132.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0cec7519: serviceaccount "payload-processing-e2e-migrate-0cec7519" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0cec7519

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0cec7519

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0cec7519-65d485fdcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0cec7519-65d485fdcd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0cec7519-65d485fdcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0cec7519: serviceaccount "payload-processing-e2e-migrate-0cec7519" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0cec7519-65d485fdcd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh
(x2)

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-0cec7519-gw-openshift-default-6b58cc6b88-9fts8

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-0da90685-openshift-default-57c945b59d

SuccessfulCreate

Created pod: e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

openshift-ingress

deployment-controller

e2e-ait-0da90685-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0da90685-openshift-default-57c945b59d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-0da90685

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0da90685

openshift-ingress

multus

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0da90685-54dfc94494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0da90685-df45955bf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0da90685-df45955bf-qspbk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0da90685

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0da90685-df45955bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0da90685-df45955bf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0da90685-df45955bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0da90685: serviceaccount "payload-processing-e2e-ait-0da90685" not found

openshift-ingress

multus

payload-processing-e2e-ait-0da90685-df45955bf-qspbk

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0da90685

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0da90685-54dfc94494 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0da90685-54dfc94494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0da90685-54dfc94494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0da90685: serviceaccount "payload-processing-e2e-ait-0da90685" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0da90685-df45955bf-qspbk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0da90685-df45955bf-qspbk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0da90685-df45955bf-qspbk

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-0da90685-df45955bf-qspbk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-a01e15d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-a01e15d8-openshift-default-bf6bb457b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-a01e15d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-a01e15d8

openshift-ingress

multus

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-a01e15d8-openshift-default-bf6bb457b

SuccessfulCreate

Created pod: e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

openshift-ingress

multus

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-a01e15d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-a01e15d8-6757cddb57 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a01e15d8: serviceaccount "payload-processing-e2e-derive-a01e15d8" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a01e15d8-6757cddb57

FailedCreate

Error creating: pods "payload-processing-e2e-derive-a01e15d8-6757cddb57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-a01e15d8: serviceaccount "payload-processing-e2e-derive-a01e15d8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-a01e15d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-a01e15d8-6757cddb57

SuccessfulCreate

Created pod: payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

openshift-ingress

kubelet

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-abf07f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-abf07f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-abf07f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-abf07f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d95fede4-c89f-462b-b552-f0d2338adc56, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-a01e15d8-openshift-default-dockercfg-pb7w6); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

Unhealthy

Readiness probe failed: dial tcp 10.134.0.44:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76

Unhealthy

Readiness probe failed: dial tcp 10.134.0.45:9004: i/o timeout

openshift-ingress

kubelet

e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-c28cf7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-c28cf7

openshift-ingress

deployment-controller

e2e-explicit-c28cf7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-c28cf7-openshift-default-5f67575fd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-c28cf7-openshift-default-5f67575fd8

SuccessfulCreate

Created pod: e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

openshift-ingress

multus

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-abf07f-openshift-default-796b6f5978-8jvkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-c28cf7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-c28cf7-6d66958785 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c28cf7-6d66958785

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-c28cf7-6d66958785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c28cf7: serviceaccount "payload-processing-e2e-explicit-c28cf7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-c28cf7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-c28cf7-96c859fcd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-c28cf7: serviceaccount "payload-processing-e2e-explicit-c28cf7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-c28cf7-6d66958785

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

openshift-ingress

kubelet

payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-7ce8ca0e-openshift-default-7479867c6

SuccessfulCreate

Created pod: e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

openshift-ingress

deployment-controller

e2e-mt-7ce8ca0e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7ce8ca0e-openshift-default-7479867c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-7ce8ca0e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7ce8ca0e

openshift-ingress

multus

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7ce8ca0e: serviceaccount "payload-processing-e2e-mt-7ce8ca0e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7ce8ca0e: serviceaccount "payload-processing-e2e-mt-7ce8ca0e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7ce8ca0e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7ce8ca0e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7ce8ca0e-6cfc88b597 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-c28cf7-6d66958785-8swln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-981036

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-981036

openshift-ingress

deployment-controller

e2e-noten-981036-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-981036-openshift-default-69b54f868b from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-981036-openshift-default-69b54f868b

SuccessfulCreate

Created pod: e2e-noten-981036-openshift-default-69b54f868b-bpnx6

openshift-ingress

kubelet

e2e-noten-981036-openshift-default-69b54f868b-bpnx6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

ProbeError

Readiness probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Unhealthy

Readiness probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-981036-openshift-default-69b54f868b-bpnx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-981036-openshift-default-69b54f868b-bpnx6

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-981036-openshift-default-69b54f868b-bpnx6

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7ce8ca0e-64d64786f4-xbvmv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-577f23

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-577f23

openshift-ingress

deployment-controller

e2e-shared-a-w2-577f23-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-577f23-openshift-default-6c695c85db from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-577f23-openshift-default-6c695c85db

SuccessfulCreate

Created pod: e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

openshift-ingress

multus

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-577f23: serviceaccount "payload-processing-e2e-shared-a-w2-577f23" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-577f23

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-577f23: serviceaccount "payload-processing-e2e-shared-a-w2-577f23" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-577f23

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-577f23-7df4bd789c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb

SuccessfulCreate

Created pod: e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

openshift-ingress

multus

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-f032a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-f032a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-f032a1

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-f032a1

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-f032a1-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-f032a1-authn-ssl" already exists

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Unhealthy

Readiness probe failed: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

ProbeError

Readiness probe error: Get "http://10.134.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1: serviceaccount "payload-processing-e2e-shared-b-w2-f032a1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1: serviceaccount "payload-processing-e2e-shared-b-w2-f032a1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-f032a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-f032a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-f032a1-74c96f866f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-2430e2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-2430e2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 97abc95d-0847-47cb-a27e-d94e66c55649, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2430e2-74f94f8779-cgkqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-981036-openshift-default-69b54f868b-bpnx6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-fcb750c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-fcb750c6-openshift-default-747d7bcf88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-fcb750c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-fcb750c6

openshift-ingress

replicaset-controller

e2e-mt-fcb750c6-openshift-default-747d7bcf88

SuccessfulCreate

Created pod: e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

openshift-ingress

multus

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-fcb750c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-fcb750c6-77bbd7cdcc from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fcb750c6: serviceaccount "payload-processing-e2e-mt-fcb750c6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-fcb750c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-fcb750c6: serviceaccount "payload-processing-e2e-mt-fcb750c6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-f79800

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-f79800

openshift-ingress

replicaset-controller

e2e-shared-a-w3-f79800-openshift-default-7b749854cb

SuccessfulCreate

Created pod: e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

openshift-ingress

multus

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-f79800-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-f79800-openshift-default-7b749854cb from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-2430e2-openshift-default-54fd5f9b88-96f4c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-f79800

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-f79800-85b645df8c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f79800-85b645df8c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-f79800

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-f79800-85b645df8c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-f79800-85b645df8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f79800: serviceaccount "payload-processing-e2e-shared-a-w3-f79800" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-f79800: serviceaccount "payload-processing-e2e-shared-a-w3-f79800" not found

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948

SuccessfulCreate

Created pod: e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

openshift-ingress

deployment-controller

e2e-shared-b-w3-8dd3bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-8dd3bd-openshift-default-68786d948 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-8dd3bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-8dd3bd

openshift-ingress

multus

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-8dd3bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-8dd3bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd: serviceaccount "payload-processing-e2e-shared-b-w3-8dd3bd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd: serviceaccount "payload-processing-e2e-shared-b-w3-8dd3bd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-fcb750c6-77bbd7cdcc-h9kwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-730be9-openshift-default-5ccb6f57f6

SuccessfulCreate

Created pod: e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

openshift-ingress

deployment-controller

e2e-api-a-730be9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-730be9-openshift-default-5ccb6f57f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-730be9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-730be9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-730be9-778974d799

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-730be9-778974d799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-730be9: serviceaccount "payload-processing-e2e-api-a-730be9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-730be9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-730be9-fbf95b67d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-730be9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-730be9-778974d799 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-730be9-778974d799

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-730be9-778974d799-cxwd6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-730be9-fbf95b67d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-730be9-fbf95b67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-730be9: serviceaccount "payload-processing-e2e-api-a-730be9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-730be9-fbf95b67d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-730be9-778974d799-cxwd6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-730be9-778974d799-cxwd6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-730be9-778974d799-cxwd6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-730be9-778974d799-cxwd6

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-ff390e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ff390e
(x2)

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-ff390e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ff390e-openshift-default-5b8f79df9b from 0 to 1

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Unhealthy

Readiness probe failed: Get "http://10.134.0.73:15021/healthz/ready": read tcp 10.134.0.2:42376->10.134.0.73:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

ProbeError

Readiness probe error: Get "http://10.134.0.73:15021/healthz/ready": read tcp 10.134.0.2:42376->10.134.0.73:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

e2e-api-b-ff390e-openshift-default-5b8f79df9b

SuccessfulCreate

Created pod: e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4
(x2)

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-ff390e-58c965479-4kdff

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ff390e-58c965479

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ff390e-58c965479-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ff390e: serviceaccount "payload-processing-e2e-api-b-ff390e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ff390e-58c965479-4kdff

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ff390e-58c965479-4kdff

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ff390e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ff390e-86b5597f74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ff390e-86b5597f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ff390e-86b5597f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ff390e: serviceaccount "payload-processing-e2e-api-b-ff390e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ff390e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ff390e-58c965479 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ff390e-58c965479

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ff390e-58c965479-4kdff

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-ff390e-58c965479-4kdff

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ff390e-86b5597f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-ffb593

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-ffb593": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6658e284-c77b-43e9-8ddc-932ddb3984b9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-a-730be9-778974d799-cxwd6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ff390e-86b5597f74-c96bz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ff390e-58c965479-4kdff

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-ff390e-openshift-default-5b8f79df9b-7vnp4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-577f23-844cc79f78-nhm7g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-f032a1-openshift-default-5f4bb9c4bb-xl5hd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-890f3e-7bd44bbc89-j8jbd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-890f3e-openshift-default-6844dc9c86-vsbqk

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-08aa53

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-08aa53

openshift-ingress

replicaset-controller

e2e-ipp-a-08aa53-openshift-default-76b696fbc4

SuccessfulCreate

Created pod: e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

openshift-ingress

deployment-controller

e2e-ipp-a-08aa53-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-08aa53-openshift-default-76b696fbc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-08aa53: serviceaccount "payload-processing-e2e-ipp-a-08aa53" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-08aa53

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-08aa53-8655688949 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-08aa53

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-08aa53-8655688949

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-08aa53-8655688949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-08aa53: serviceaccount "payload-processing-e2e-ipp-a-08aa53" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-08aa53-8655688949

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-6920e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-6920e5-openshift-default-66bff957cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-6920e5-openshift-default-66bff957cd

SuccessfulCreate

Created pod: e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-6920e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-6920e5

openshift-ingress

multus

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6920e5: serviceaccount "payload-processing-e2e-ipp-b-6920e5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-6920e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-6920e5-5bd9d56b77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-6920e5: serviceaccount "payload-processing-e2e-ipp-b-6920e5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-6920e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

AddedInterface

Add eth0 [10.134.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-14495e-openshift-default-769589479b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

openshift-ingress

deployment-controller

e2e-ipp-cleanup-14495e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-14495e-openshift-default-769589479b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-14495e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-14495e

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-14495e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e: serviceaccount "payload-processing-e2e-ipp-cleanup-14495e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-14495e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-14495e: serviceaccount "payload-processing-e2e-ipp-cleanup-14495e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

ProbeError

Startup probe error: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Unhealthy

Startup probe failed: Get "http://10.134.0.88:15021/healthz/ready": dial tcp 10.134.0.88:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-14495e-6c8f74f4dc-ftkmn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-08aa53-openshift-default-76b696fbc4-dm8hd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-6920e5-openshift-default-66bff957cd-6pq44

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-f79800-openshift-default-7b749854cb-xhn79

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-8dd3bd-openshift-default-68786d948-7xwtp

Killing

Stopping container istio-proxy