Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48 to ip-10-0-142-68.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcpklcg to ip-10-0-130-249.ec2.internal

openshift-ingress

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-04dfc68a-6dd969499-m87st to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8 to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2 to ip-10-0-130-249.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9 to ip-10-0-135-201.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gmnj8 to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-7pdc7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-7pdc7 to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7 to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9 to ip-10-0-130-249.ec2.internal

openshift-ingress

kube-auth-proxy-6f69648866-w6nq7

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f69648866-w6nq7 to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Scheduled

Successfully assigned openshift-ingress/e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6 to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5 to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

Scheduled

Successfully assigned openshift-ingress/e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd to ip-10-0-135-201.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-49x7k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-49x7k to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8 to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-vjxxl

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-vjxxl to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r to ip-10-0-135-201.ec2.internal

openshift-ingress

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

Scheduled

Successfully assigned openshift-ingress/e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps to ip-10-0-130-249.ec2.internal

openshift-ingress

router-default-76f86fcc44-d46qd

Scheduled

Successfully assigned openshift-ingress/router-default-76f86fcc44-d46qd to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99 to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7 to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss to ip-10-0-142-68.ec2.internal

openshift-ingress

payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8 to ip-10-0-135-201.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-cthr2

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-cthr2 to ip-10-0-135-201.ec2.internal

openshift-ingress

kube-auth-proxy-6f69648866-xgxnx

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6f69648866-xgxnx to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9 to ip-10-0-142-68.ec2.internal

openshift-ingress

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77 to ip-10-0-130-249.ec2.internal

openshift-ingress

payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7 to ip-10-0-135-201.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8 to ip-10-0-135-201.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-76f86fcc44 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-76f86fcc44

FailedCreate

Error creating: pods "router-default-76f86fcc44-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-76f86fcc44

FailedCreate

Error creating: pods "router-default-76f86fcc44-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-76f86fcc44

SuccessfulCreate

Created pod: router-default-76f86fcc44-d46qd
(x5)

openshift-ingress

kubelet

router-default-76f86fcc44-d46qd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-76f86fcc44-d46qd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-76f86fcc44-d46qd

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-76f86fcc44-d46qd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-76f86fcc44-d46qd

Created

Created container: router

openshift-ingress

kubelet

router-default-76f86fcc44-d46qd

Started

Started container router
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-6f69648866

FailedCreate

Error creating: pods "kube-auth-proxy-6f69648866-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6f69648866 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-xgxnx

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-6f69648866-w6nq7

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-w6nq7

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-6f69648866

SuccessfulCreate

Created pod: kube-auth-proxy-6f69648866-xgxnx

openshift-ingress

replicaset-controller

kube-auth-proxy-6f69648866

SuccessfulCreate

Created pod: kube-auth-proxy-6f69648866-w6nq7

openshift-ingress

multus

kube-auth-proxy-6f69648866-xgxnx

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-49x7k

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-49x7k

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-w6nq7

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-49x7k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-w6nq7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.824s (2.824s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-xgxnx

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-xgxnx

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-xgxnx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.849s (2.849s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6f69648866-w6nq7

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-49x7k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.633s (2.633s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-49x7k

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-49x7k

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.787s (2.787s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.98s (2.98s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-ntvhr

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

Unhealthy

Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcpklcg

ProbeError

Startup probe error: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-cthr2

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cthr2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-cthr2

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cthr2

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cthr2

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-cthr2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.71s (3.71s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-49x7k

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-49x7k

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-gmnj8

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-vjxxl
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-7pdc7

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-vjxxl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-7pdc7

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-vjxxl

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7pdc7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-vjxxl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.077s (2.077s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-vjxxl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-vjxxl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7pdc7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7pdc7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.945s (1.945s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-7pdc7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

Unhealthy

Readiness probe failed: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

ProbeError

Readiness probe error: Get "http://10.133.0.31:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

ProbeError

Startup probe error: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gmnj8

Unhealthy

Startup probe failed: Get "http://10.133.0.31:15021/healthz/ready": dial tcp 10.133.0.31:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-c892fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-c892fe

openshift-ingress

deployment-controller

e2e-inf-a-c892fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-c892fe-openshift-default-76b977cf5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-c892fe-openshift-default-76b977cf5b

SuccessfulCreate

Created pod: e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

openshift-ingress

multus

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c892fe-847c545bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-c892fe-847c545bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c892fe: serviceaccount "payload-processing-e2e-inf-a-c892fe" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-c892fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-c892fe-847c545bc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-c892fe: serviceaccount "payload-processing-e2e-inf-a-c892fe" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-c892fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-c892fe-847c545bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-e8a6c27c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e8a6c27c

openshift-ingress

deployment-controller

e2e-autores-e7415a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-e7415a-openshift-default-7dcddfd4f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-e7415a-openshift-default-7dcddfd4f6

SuccessfulCreate

Created pod: e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

openshift-ingress

gateway_labeler_controller

e2e-autores-e7415a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-e7415a

openshift-ingress

replicaset-controller

e2e-ait-e8a6c27c-openshift-default-cd94f6d66

SuccessfulCreate

Created pod: e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

openshift-ingress

multus

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-e8a6c27c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e8a6c27c-openshift-default-cd94f6d66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e7415a-597bb6dbcf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-e7415a-597bb6dbcf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e7415a: serviceaccount "payload-processing-e2e-autores-e7415a" not found

openshift-ingress

multus

payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e7415a-597bb6dbcf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

openshift-ingress

deployment-controller

payload-processing-e2e-autores-e7415a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-e7415a-597bb6dbcf from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-e7415a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-e7415a-565ff8fd74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e7415a-565ff8fd74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e7415a-565ff8fd74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-e7415a-565ff8fd74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e7415a: serviceaccount "payload-processing-e2e-autores-e7415a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8a6c27c: serviceaccount "payload-processing-e2e-ait-e8a6c27c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e8a6c27c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e8a6c27c-54b9b77cd9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e8a6c27c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e8a6c27c: serviceaccount "payload-processing-e2e-ait-e8a6c27c" not found

openshift-ingress

multus

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x6)

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-inf-b-2365fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-2365fe-openshift-default-657649bbb from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-2365fe-openshift-default-657649bbb

SuccessfulCreate

Created pod: e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw
(x2)

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-2365fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-2365fe
(x2)

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-2365fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-2365fe-794d747c94 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2365fe-bfc98b7bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-2365fe-bfc98b7bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-2365fe-bfc98b7bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2365fe: serviceaccount "payload-processing-e2e-inf-b-2365fe" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2365fe-794d747c94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-2365fe-794d747c94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-2365fe-794d747c94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-2365fe: serviceaccount "payload-processing-e2e-inf-b-2365fe" not found
(x5)

openshift-ingress

kubelet

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-2365fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-2365fe-bfc98b7bf from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-e8a6c27c-openshift-default-cd94f6d66-d9cf5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-e8a6c27c-54b9b77cd9-xl4qf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e8a6c27c-68f8697c8-s8vb2

Killing

Stopping container payload-pre-processing

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-7e4309cc-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-7e4309cc-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-7e4309cc-gw-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-migrate-7e4309cc-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7e4309cc-gw

openshift-ingress

deployment-controller

e2e-migrate-7e4309cc-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48

SuccessfulCreate

Created pod: e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

openshift-ingress

multus

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7e4309cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7e4309cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7e4309cc-65cb64f6cd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7e4309cc: serviceaccount "payload-processing-e2e-migrate-7e4309cc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

openshift-ingress

multus

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7e4309cc: serviceaccount "payload-processing-e2e-migrate-7e4309cc" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv
(x5)

openshift-ingress

kubelet

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7e4309cc-fbf7856f8-kqqvv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7e4309cc-65cb64f6cd-7ffq7

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-04dfc68a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-04dfc68a-openshift-default-df8cd6864 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-7e4309cc-gw-openshift-default-78998b5d48-v2wx8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-04dfc68a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-04dfc68a

openshift-ingress

replicaset-controller

e2e-ait-04dfc68a-openshift-default-df8cd6864

SuccessfulCreate

Created pod: e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

openshift-ingress

multus

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04dfc68a-6dd969499

SuccessfulCreate

Created pod: payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

openshift-ingress

kubelet

payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04dfc68a: serviceaccount "payload-processing-e2e-ait-04dfc68a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-04dfc68a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-04dfc68a-6dd969499

FailedCreate

Error creating: pods "payload-processing-e2e-ait-04dfc68a-6dd969499-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-04dfc68a: serviceaccount "payload-processing-e2e-ait-04dfc68a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-04dfc68a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-04dfc68a-6dd969499 from 0 to 1

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": read tcp 10.133.0.2:37306->10.133.0.46:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": read tcp 10.133.0.2:37306->10.133.0.46:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-04dfc68a-6b4f57c9b6-jtmmv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-04dfc68a-6dd969499-m87st

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e7415a-597bb6dbcf-664tv

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-e7415a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-e7415a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-e7415a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-e7415a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 18cee161-2a9c-41bb-b587-c3929cbe8df2, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e7415a-565ff8fd74-w2k5w

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-04dfc68a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-04dfc68a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-04dfc68a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 54f1fbac-01db-48ae-97a6-bf67f5fff5a4, UID in object meta:

openshift-ingress

kubelet

e2e-ait-04dfc68a-openshift-default-df8cd6864-25hnc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d

SuccessfulCreate

Created pod: e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

openshift-ingress

gateway_labeler_controller

e2e-derive-b46e5fd4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b46e5fd4

openshift-ingress

deployment-controller

e2e-derive-b46e5fd4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d from 0 to 1

openshift-ingress

multus

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b46e5fd4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b46e5fd4-66b995bf7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b46e5fd4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b46e5fd4: serviceaccount "payload-processing-e2e-derive-b46e5fd4" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b46e5fd4-66b995bf7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b46e5fd4-66b995bf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b46e5fd4: serviceaccount "payload-processing-e2e-derive-b46e5fd4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b46e5fd4-66b995bf7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-autores-e7415a-openshift-default-7dcddfd4f6-vvsps

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-b2dfe7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-b2dfe7

openshift-ingress

replicaset-controller

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d

SuccessfulCreate

Created pod: e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

openshift-ingress

deployment-controller

e2e-explicit-b2dfe7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-b2dfe7-openshift-default-75c79cbf4d from 0 to 1

openshift-ingress

multus

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-b2dfe7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-b2dfe7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-b2dfe7-7c8f4f454f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b2dfe7: serviceaccount "payload-processing-e2e-explicit-b2dfe7" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-b2dfe7: serviceaccount "payload-processing-e2e-explicit-b2dfe7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

openshift-ingress

multus

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-b46e5fd4-66b995bf7-f6fk6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b46e5fd4-6df7cfd68b-vrgl6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-b46e5fd4-openshift-default-6c6bb8fc6d-gmfhj

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-b2dfe7-7c8f4f454f-24r96

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-b2dfe7-86c8497d98-hgbkg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-1ad4f6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-1ad4f6

openshift-ingress

kubelet

e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-noten-1ad4f6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-1ad4f6-openshift-default-fc49fb496 from 0 to 1

openshift-ingress

kubelet

e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-1ad4f6-openshift-default-fc49fb496

SuccessfulCreate

Created pod: e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-b2dfe7-openshift-default-75c79cbf4d-lllk9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-1ad4f6-openshift-default-fc49fb496-8k5wq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-c892fe-67f4cc8c4b-j5lbd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-c892fe-847c545bc-hgswv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-c892fe-openshift-default-76b977cf5b-dkz77

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-mt-db3978e3-openshift-default-6c9554555b

SuccessfulCreate

Created pod: e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

openshift-ingress

deployment-controller

e2e-mt-db3978e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-db3978e3-openshift-default-6c9554555b from 0 to 1

openshift-ingress

multus

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-db3978e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-db3978e3

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-db3978e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-db3978e3-cd977579d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-db3978e3-7d77f99cbf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-db3978e3-7d77f99cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-db3978e3: serviceaccount "payload-processing-e2e-mt-db3978e3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-db3978e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-db3978e3-7d77f99cbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-db3978e3-7d77f99cbf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-db3978e3-cd977579d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-db3978e3-cd977579d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-db3978e3-cd977579d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-db3978e3: serviceaccount "payload-processing-e2e-mt-db3978e3" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-2365fe-bfc98b7bf-rgth7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-2365fe-794d747c94-7fp2r

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454

SuccessfulCreate

Created pod: e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

openshift-ingress

kubelet

e2e-inf-b-2365fe-openshift-default-657649bbb-h6dvw

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-85d86b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-85d86b

openshift-ingress

deployment-controller

e2e-shared-a-w3-85d86b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-85d86b: serviceaccount "payload-processing-e2e-shared-a-w3-85d86b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-85d86b-55574f977c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-85d86b-55574f977c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-85d86b: serviceaccount "payload-processing-e2e-shared-a-w3-85d86b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-85d86b-55574f977c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-85d86b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-85d86b-55574f977c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-85d86b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:58414->10.132.0.63:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:58414->10.132.0.63:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3477ac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3477ac

openshift-ingress

deployment-controller

e2e-shared-b-w3-3477ac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb

SuccessfulCreate

Created pod: e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

openshift-ingress

multus

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-db3978e3-cd977579d-rcxwh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-db3978e3-7d77f99cbf-6g7w8

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3477ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3477ac-86964d9867 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3477ac-86964d9867

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3477ac-86964d9867-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac: serviceaccount "payload-processing-e2e-shared-b-w3-3477ac" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3477ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3477ac: serviceaccount "payload-processing-e2e-shared-b-w3-3477ac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3477ac-86964d9867

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-mt-db3978e3-openshift-default-6c9554555b-h4hqc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:54500->10.132.0.64:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": read tcp 10.132.0.2:54500->10.132.0.64:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-bc9af3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-bc9af3

openshift-ingress

multus

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74

SuccessfulCreate

Created pod: e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

openshift-ingress

deployment-controller

e2e-shared-a-w2-bc9af3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3: serviceaccount "payload-processing-e2e-shared-a-w2-bc9af3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-bc9af3: serviceaccount "payload-processing-e2e-shared-a-w2-bc9af3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-bc9af3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-bc9af3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-86a2c6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68

SuccessfulCreate

Created pod: e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-86a2c6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-86a2c6

openshift-ingress

multus

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-86a2c6: serviceaccount "payload-processing-e2e-shared-b-w2-86a2c6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-86a2c6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-86a2c6: serviceaccount "payload-processing-e2e-shared-b-w2-86a2c6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-86a2c6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-dfd05fbc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8

SuccessfulCreate

Created pod: e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

openshift-ingress

gateway_labeler_controller

e2e-mt-dfd05fbc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-dfd05fbc

openshift-ingress

multus

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-dfd05fbc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-dfd05fbc-575f9858f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-dfd05fbc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dfd05fbc: serviceaccount "payload-processing-e2e-mt-dfd05fbc" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dfd05fbc-575f9858f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-dfd05fbc-575f9858f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-dfd05fbc: serviceaccount "payload-processing-e2e-mt-dfd05fbc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-dfd05fbc-575f9858f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

openshift-ingress

multus

payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-dfd05fbc-76bb8b4698-q9n6b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-dfd05fbc-575f9858f-krpss

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-dfd05fbc-openshift-default-6fb7c5b6b8-7xx7c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-9c318b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-9c318b-openshift-default-7c55dbc67b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-9c318b-openshift-default-7c55dbc67b

SuccessfulCreate

Created pod: e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

openshift-ingress

gateway_labeler_controller

e2e-api-a-9c318b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-9c318b

openshift-ingress

multus

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9c318b-575459d7f9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-9c318b-575459d7f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9c318b: serviceaccount "payload-processing-e2e-api-a-9c318b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-9c318b-575459d7f9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-9c318b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-9c318b-575459d7f9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-9c318b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-9c318b: serviceaccount "payload-processing-e2e-api-a-9c318b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-api-b-84eb72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-84eb72

openshift-ingress

replicaset-controller

e2e-api-b-84eb72-openshift-default-76dd9c9f94

SuccessfulCreate

Created pod: e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

openshift-ingress

deployment-controller

e2e-api-b-84eb72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-84eb72-openshift-default-76dd9c9f94 from 0 to 1

openshift-ingress

multus

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-84eb72-cf68c6c49

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-84eb72-cf68c6c49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-84eb72: serviceaccount "payload-processing-e2e-api-b-84eb72" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-84eb72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-84eb72: serviceaccount "payload-processing-e2e-api-b-84eb72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-84eb72-cf68c6c49

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-84eb72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-84eb72-cf68c6c49 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

ProbeError

Startup probe error: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

Unhealthy

Startup probe failed: Get "http://10.133.0.74:15021/healthz/ready": dial tcp 10.133.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-9c318b-6d6b457fbb-89dwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-9c318b-575459d7f9-tlq9c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-9c318b-openshift-default-7c55dbc67b-tlc8f

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-84eb72-68f7b7c9d-l58dp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-84eb72-cf68c6c49-r2w4q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-84eb72-openshift-default-76dd9c9f94-7l6b4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-cc50fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-cc50fd-openshift-default-58d985dd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-cc50fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-cc50fd

openshift-ingress

replicaset-controller

e2e-ipp-a-cc50fd-openshift-default-58d985dd8

SuccessfulCreate

Created pod: e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

openshift-ingress

multus

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-bc9af3-85bbcd4d77-hx2nl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-bc9af3-84664d596b-j8sr8

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-cc50fd-76f556bccf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-cc50fd-76f556bccf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-cc50fd: serviceaccount "payload-processing-e2e-ipp-a-cc50fd" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-cc50fd-76f556bccf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-cc50fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-cc50fd-76f556bccf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-cc50fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-cc50fd: serviceaccount "payload-processing-e2e-ipp-a-cc50fd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-bc9af3-openshift-default-6f7d9bfb74-5gww5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-86a2c6-9df568cf9-6bj99

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-86a2c6-7897ddc4c4-hdmgj

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-b-eaf326-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-eaf326-openshift-default-7b854cd75d from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-86a2c6-openshift-default-5d5db58c68-tfp4t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-b-eaf326-openshift-default-7b854cd75d

SuccessfulCreate

Created pod: e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-eaf326

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-eaf326

openshift-ingress

multus

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eaf326: serviceaccount "payload-processing-e2e-ipp-b-eaf326" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-eaf326: serviceaccount "payload-processing-e2e-ipp-b-eaf326" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-eaf326

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-eaf326-79dcbd66b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-eaf326

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Unhealthy

Readiness probe failed: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

ProbeError

Readiness probe error: Get "http://10.132.0.86:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

ProbeError

Startup probe error: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Unhealthy

Startup probe failed: Get "http://10.132.0.86:15021/healthz/ready": dial tcp 10.132.0.86:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-3876ff

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-3876ff

openshift-ingress

deployment-controller

e2e-ipp-cleanup-3876ff-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

openshift-ingress

multus

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-3876ff

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3876ff: serviceaccount "payload-processing-e2e-ipp-cleanup-3876ff" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-3876ff: serviceaccount "payload-processing-e2e-ipp-cleanup-3876ff" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-3876ff

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-3876ff-dbcf68c6b-f2ql9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-3876ff-79b4f9d98c-b6c48

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-3876ff-openshift-default-689cdb55fb-2bch9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc50fd-76f556bccf-n8ng9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc50fd-dd866dc66-9mqzt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-cc50fd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-cc50fd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-cc50fd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-cc50fd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c4e9d2cb-bd4b-4080-9408-19bf80b30e5a, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-cc50fd-openshift-default-58d985dd8-xn26k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-eaf326-79dcbd66b9-jqqvj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-eaf326-6bf5c56ccd-th8gs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-eaf326-openshift-default-7b854cd75d-pqlqm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-85d86b-7964fb96c4-5kdhk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-85d86b-55574f977c-bfkm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-85d86b-openshift-default-cd4f7b454-hkzz2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3477ac-5b46464858-6str8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3477ac-86964d9867-qlmwz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-3477ac-openshift-default-79ccdb68cb-x4dvq

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Distiod%2Cistio.io%2Frev%3Dopenshift-gateway\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: unable to fetch metrics from resource metrics API: an error on the server ("Internal Server Error: \"/apis/metrics.k8s.io/v1beta1/namespaces/openshift-ingress/pods?labelSelector=app%3Dkube-auth-proxy\": Post \"https://172.31.0.1:443/apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s\": context deadline exceeded") has prevented the request from succeeding (get pods.metrics.k8s.io)