Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2 to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-b1f490-5f54877b85-4d97t to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-5d0c07-5846969b97-s855c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-5d0c07-5846969b97-s855c to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7 to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

Scheduled

Successfully assigned openshift-ingress/e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t to ip-10-0-139-172.ec2.internal

openshift-ingress

kube-auth-proxy-69ddc5c8c5-jr7wq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-69ddc5c8c5-jr7wq to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2 to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7 to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh to ip-10-0-133-48.ec2.internal

openshift-ingress

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz to ip-10-0-133-48.ec2.internal

openshift-ingress

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22 to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-tklgb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-tklgb to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

Scheduled

Successfully assigned openshift-ingress/e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn to ip-10-0-139-172.ec2.internal

openshift-ingress

kube-auth-proxy-69ddc5c8c5-5dr6s

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-69ddc5c8c5-5dr6s to ip-10-0-140-8.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4 to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5 to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-mbq7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-mbq7f to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc to ip-10-0-133-48.ec2.internal

openshift-ingress

router-default-64447d557d-vpzh2

Scheduled

Successfully assigned openshift-ingress/router-default-64447d557d-vpzh2 to ip-10-0-139-172.ec2.internal

openshift-ingress

router-default-64447d557d-vpzh2

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5 to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

Scheduled

Successfully assigned openshift-ingress/e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8 to ip-10-0-133-48.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8 to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq to ip-10-0-140-8.ec2.internal

openshift-ingress

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Scheduled

Successfully assigned openshift-ingress/e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w to ip-10-0-139-172.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552 to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7 to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n to ip-10-0-140-8.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm to ip-10-0-140-8.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-9dzjc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-9dzjc to ip-10-0-139-172.ec2.internal

openshift-ingress

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6 to ip-10-0-139-172.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-v29wf to ip-10-0-133-48.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vtpkc

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vtpkc to ip-10-0-133-48.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-64447d557d from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-64447d557d

FailedCreate

Error creating: pods "router-default-64447d557d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x2)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-64447d557d

SuccessfulCreate

Created pod: router-default-64447d557d-vpzh2
(x6)

openshift-ingress

kubelet

router-default-64447d557d-vpzh2

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-64447d557d-vpzh2

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-64447d557d-vpzh2

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-64447d557d-vpzh2

Created

Created container: router

openshift-ingress

multus

router-default-64447d557d-vpzh2

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-64447d557d-vpzh2

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-69ddc5c8c5 from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-69ddc5c8c5

FailedCreate

Error creating: pods "kube-auth-proxy-69ddc5c8c5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-69ddc5c8c5

SuccessfulCreate

Created pod: kube-auth-proxy-69ddc5c8c5-jr7wq

openshift-ingress

replicaset-controller

kube-auth-proxy-69ddc5c8c5

SuccessfulCreate

Created pod: kube-auth-proxy-69ddc5c8c5-5dr6s

openshift-ingress

multus

kube-auth-proxy-69ddc5c8c5-jr7wq

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-jr7wq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-5dr6s

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-69ddc5c8c5-5dr6s

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vtpkc

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vtpkc

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-5dr6s

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-5dr6s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.817s (2.817s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-5dr6s

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-jr7wq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.829s (2.829s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-jr7wq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-69ddc5c8c5-jr7wq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.369s (3.369s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cdm5l4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.605s (2.605s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-9dzjc

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-9dzjc

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9dzjc

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9dzjc

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.125s (2.125s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9dzjc

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-9dzjc

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vtpkc

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vtpkc

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-v29wf

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-v29wf

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.818s (2.818s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-mbq7f

openshift-ingress

multus

payload-processing-5b54b7fbb7-mbq7f

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mbq7f

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-tklgb

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tklgb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-tklgb

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tklgb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tklgb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-tklgb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.533s (1.533s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mbq7f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mbq7f

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.52s (1.52s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-mbq7f

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v29wf

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-86fdcf-openshift-default-d74fbbd56

SuccessfulCreate

Created pod: e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

openshift-ingress

deployment-controller

e2e-inf-a-86fdcf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-86fdcf-openshift-default-d74fbbd56 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-86fdcf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-86fdcf

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-86fdcf-6cb885c959

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-86fdcf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-86fdcf-7db85489db from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-86fdcf: serviceaccount "payload-processing-e2e-inf-a-86fdcf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-86fdcf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-86fdcf-6cb885c959 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-86fdcf-6cb885c959

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-86fdcf-6cb885c959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-86fdcf: serviceaccount "payload-processing-e2e-inf-a-86fdcf" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-b1f490

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-b1f490

openshift-ingress

replicaset-controller

e2e-autores-b1f490-openshift-default-5f7759bf98

SuccessfulCreate

Created pod: e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

openshift-ingress

deployment-controller

e2e-autores-b1f490-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-b1f490-openshift-default-5f7759bf98 from 0 to 1

openshift-ingress

multus

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-854ac94d-openshift-default-77c9c96bd4

SuccessfulCreate

Created pod: e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

openshift-ingress

deployment-controller

e2e-ait-854ac94d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-854ac94d-openshift-default-77c9c96bd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-854ac94d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-854ac94d

openshift-ingress

multus

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b1f490-5f54877b85

SuccessfulCreate

Created pod: payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

openshift-ingress

deployment-controller

payload-processing-e2e-autores-b1f490

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-b1f490-5f54877b85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-b1f490

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-b1f490-77f869c5bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b1f490-77f869c5bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b1f490-77f869c5bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-b1f490-77f869c5bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b1f490: serviceaccount "payload-processing-e2e-autores-b1f490" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b1f490-5f54877b85

FailedCreate

Error creating: pods "payload-processing-e2e-autores-b1f490-5f54877b85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b1f490: serviceaccount "payload-processing-e2e-autores-b1f490" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-854ac94d-85597c476c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

openshift-ingress

deployment-controller

payload-processing-e2e-ait-854ac94d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-854ac94d-85597c476c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-854ac94d: serviceaccount "payload-processing-e2e-ait-854ac94d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-854ac94d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-854ac94d-5844ffd66b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-854ac94d-85597c476c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-854ac94d-85597c476c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-854ac94d: serviceaccount "payload-processing-e2e-ait-854ac94d" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Unhealthy

Readiness probe failed: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

ProbeError

Readiness probe error: Get "http://10.132.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": read tcp 10.134.0.2:47724->10.134.0.38:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": read tcp 10.134.0.2:47724->10.134.0.38:15021: read: connection reset by peer

openshift-ingress

deployment-controller

e2e-inf-b-02fc2e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-02fc2e-openshift-default-66d8944f96 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-02fc2e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-02fc2e
(x2)

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-02fc2e-openshift-default-66d8944f96

SuccessfulCreate

Created pod: e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6
(x2)

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-02fc2e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-02fc2e-c6594bd4c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-02fc2e-c6594bd4c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-02fc2e-c6594bd4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-02fc2e: serviceaccount "payload-processing-e2e-inf-b-02fc2e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-02fc2e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-02fc2e: serviceaccount "payload-processing-e2e-inf-b-02fc2e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-02fc2e-c6594bd4c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-854ac94d-85597c476c-vjfqp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-854ac94d-5844ffd66b-qhj5z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-854ac94d-openshift-default-77c9c96bd4-w7mwk

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb

SuccessfulCreate

Created pod: e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5
(x5)

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

ProbeError

Startup probe error: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Unhealthy

Startup probe failed: Get "http://10.132.0.44:15021/healthz/ready": dial tcp 10.132.0.44:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-migrate-0e325272-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-0e325272-gw-openshift-default-d7c579ccb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-0e325272-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-0e325272-gw

openshift-ingress

multus

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0e325272: serviceaccount "payload-processing-e2e-migrate-0e325272" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0e325272-55b8d48bcd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-0e325272

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-0e325272-55b8d48bcd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-0e325272-55b8d48bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-0e325272: serviceaccount "payload-processing-e2e-migrate-0e325272" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-0e325272

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-0e325272-55b8d48bcd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-0e325272-6d7ff4675d-txbkb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-0e325272

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-0e325272: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-0e325272": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-0e325272, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4dd3cab3-0801-4820-b0f9-c3673e0ba373, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-0e325272-55b8d48bcd-fc72c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-0e325272-gw-openshift-default-d7c579ccb-vs8k5

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-10e9e4e8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-10e9e4e8

openshift-ingress

replicaset-controller

e2e-ait-10e9e4e8-openshift-default-fc9645cb6

SuccessfulCreate

Created pod: e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

openshift-ingress

deployment-controller

e2e-ait-10e9e4e8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-10e9e4e8-openshift-default-fc9645cb6 from 0 to 1

openshift-ingress

multus

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-10e9e4e8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-10e9e4e8-7494999d6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-10e9e4e8-7494999d6f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-10e9e4e8: serviceaccount "payload-processing-e2e-ait-10e9e4e8" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-10e9e4e8-7494999d6f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-10e9e4e8-7494999d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-10e9e4e8: serviceaccount "payload-processing-e2e-ait-10e9e4e8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-10e9e4e8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b1f490-77f869c5bb-458gp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b1f490-5f54877b85-4d97t

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-10e9e4e8-7788984f4b-xfhxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-10e9e4e8-7494999d6f-8xkpn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-10e9e4e8-openshift-default-fc9645cb6-b48nn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-bc2301a5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-bc2301a5

openshift-ingress

multus

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-bc2301a5-openshift-default-66845f57cb

SuccessfulCreate

Created pod: e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

openshift-ingress

deployment-controller

e2e-derive-bc2301a5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-bc2301a5-openshift-default-66845f57cb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-bc2301a5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-bc2301a5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-bc2301a5-c68784649 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-bc2301a5-c68784649

SuccessfulCreate

Created pod: payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-bc2301a5-c68784649

FailedCreate

Error creating: pods "payload-processing-e2e-derive-bc2301a5-c68784649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-bc2301a5: serviceaccount "payload-processing-e2e-derive-bc2301a5" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-bc2301a5: serviceaccount "payload-processing-e2e-derive-bc2301a5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-bc2301a5-openshift-default-66845f57cb-fpcd8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-bc2301a5-c68784649-mkjkf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-bc2301a5-85f4c659cd-86fts

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-b1f490-openshift-default-5f7759bf98-vfs8w

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-explicit-5d0c07-openshift-default-66b4f48476

SuccessfulCreate

Created pod: e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

openshift-ingress

gateway_labeler_controller

e2e-explicit-5d0c07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-5d0c07

openshift-ingress

deployment-controller

e2e-explicit-5d0c07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-5d0c07-openshift-default-66b4f48476 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-5d0c07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-5d0c07-5846969b97 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-5d0c07-5846969b97-s855c

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d0c07-5846969b97-s855c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5d0c07-66f7795546

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-5d0c07-66f7795546-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5d0c07: serviceaccount "payload-processing-e2e-explicit-5d0c07" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d0c07-5846969b97-s855c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d0c07-5846969b97-s855c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-5d0c07-66f7795546

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5d0c07-5846969b97

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-5d0c07-5846969b97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-5d0c07: serviceaccount "payload-processing-e2e-explicit-5d0c07" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-5d0c07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-5d0c07-66f7795546 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-5d0c07-5846969b97

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-5d0c07-5846969b97-s855c
(x2)

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-5d0c07-5846969b97-s855c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-5d0c07-66f7795546-nltcg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-noten-9aacfe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-9aacfe

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-5d0c07-openshift-default-66b4f48476-58g2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-noten-9aacfe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-9aacfe-openshift-default-6876c5d58b from 0 to 1

openshift-ingress

kubelet

e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-9aacfe-openshift-default-6876c5d58b

SuccessfulCreate

Created pod: e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

openshift-ingress

multus

e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-3fe902b6-openshift-default-5bdcc847cb

SuccessfulCreate

Created pod: e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

openshift-ingress

gateway_labeler_controller

e2e-mt-3fe902b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3fe902b6

openshift-ingress

deployment-controller

e2e-mt-3fe902b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3fe902b6-openshift-default-5bdcc847cb from 0 to 1

openshift-ingress

multus

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3fe902b6-64b64df47c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3fe902b6-64b64df47c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3fe902b6: serviceaccount "payload-processing-e2e-mt-3fe902b6" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3fe902b6-756fd75898

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3fe902b6-756fd75898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3fe902b6: serviceaccount "payload-processing-e2e-mt-3fe902b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3fe902b6-756fd75898

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3fe902b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3fe902b6-64b64df47c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3fe902b6-64b64df47c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3fe902b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3fe902b6-756fd75898 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-9aacfe-openshift-default-6876c5d58b-7m87t

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-86fdcf-6cb885c959-6vx6m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-86fdcf-7db85489db-vdjs2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-86fdcf-openshift-default-d74fbbd56-j4lsl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3fe902b6-64b64df47c-wl5k7

Unhealthy

Readiness probe failed: dial tcp 10.133.0.60:9004: i/o timeout

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3fe902b6-756fd75898-85tdm

Unhealthy

Readiness probe failed: dial tcp 10.133.0.59:9004: i/o timeout

openshift-ingress

kubelet

payload-processing-e2e-inf-b-02fc2e-c6594bd4c-bj5bk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-02fc2e-84df4b4db-trkgz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-3fe902b6-openshift-default-5bdcc847cb-6s95w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-7a11e9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-7a11e9

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-7a11e9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8

SuccessfulCreate

Created pod: e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-7a11e9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7a11e9: serviceaccount "payload-processing-e2e-shared-a-w3-7a11e9" not found

openshift-ingress

kubelet

e2e-inf-b-02fc2e-openshift-default-66d8944f96-fdqj6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-7a11e9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-7a11e9: serviceaccount "payload-processing-e2e-shared-a-w3-7a11e9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-83c318-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-83c318-openshift-default-7884dbdc78 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-83c318

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-83c318

openshift-ingress

replicaset-controller

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78

SuccessfulCreate

Created pod: e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-83c318

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-83c318

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-83c318: serviceaccount "payload-processing-e2e-shared-a-w2-83c318" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Unhealthy

Readiness probe failed: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

ProbeError

Readiness probe error: Get "http://10.132.0.58:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-83c318: serviceaccount "payload-processing-e2e-shared-a-w2-83c318" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": read tcp 10.134.0.2:45544->10.134.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": read tcp 10.134.0.2:45544->10.134.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886

SuccessfulCreate

Created pod: e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-a00003

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-a00003

openshift-ingress

deployment-controller

e2e-shared-b-w3-a00003-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-a00003-openshift-default-6dd4c47886 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-a00003

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-a00003-c6dc88649 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-a00003-c6dc88649

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-a00003-c6dc88649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a00003: serviceaccount "payload-processing-e2e-shared-b-w3-a00003" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-a00003

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-a00003: serviceaccount "payload-processing-e2e-shared-b-w3-a00003" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-a00003-c6dc88649

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

Created

Created container: payload-processing

openshift-ingress

deployment-controller

e2e-shared-b-w2-a310dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a310dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a310dd

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

Started

Started container payload-processing

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb

SuccessfulCreate

Created pod: e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

openshift-ingress

multus

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a310dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a310dd-8457c575c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a310dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a310dd-8457c575c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a310dd-8457c575c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a310dd-8457c575c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a310dd: serviceaccount "payload-processing-e2e-shared-b-w2-a310dd" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a310dd: serviceaccount "payload-processing-e2e-shared-b-w2-a310dd" not found
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-713ee90e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-713ee90e

openshift-ingress

deployment-controller

e2e-mt-713ee90e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-713ee90e-openshift-default-79cf77f7bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-713ee90e-openshift-default-79cf77f7bd

SuccessfulCreate

Created pod: e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

openshift-ingress

multus

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-713ee90e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-713ee90e-d4598db85 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-713ee90e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-713ee90e-86c97fff6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-713ee90e-d4598db85

FailedCreate

Error creating: pods "payload-processing-e2e-mt-713ee90e-d4598db85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-713ee90e: serviceaccount "payload-processing-e2e-mt-713ee90e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-713ee90e: serviceaccount "payload-processing-e2e-mt-713ee90e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-713ee90e-d4598db85

SuccessfulCreate

Created pod: payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

openshift-ingress

kubelet

payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-713ee90e-d4598db85-wrfj2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-713ee90e-86c97fff6b-xmc2n

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-713ee90e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-713ee90e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-713ee90e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-713ee90e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 28b96a29-e128-4796-aa3f-25bd29877eac, UID in object meta:

openshift-ingress

kubelet

e2e-mt-713ee90e-openshift-default-79cf77f7bd-nzvq7

Killing

Stopping container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-api-a-ab74b3

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-a-ab74b3-authn-ssl: envoyfilters.networking.istio.io "e2e-api-a-ab74b3-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-api-a-ab74b3-openshift-default-56fc6f97db

SuccessfulCreate

Created pod: e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

openshift-ingress

deployment-controller

e2e-api-a-ab74b3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ab74b3-openshift-default-56fc6f97db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ab74b3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ab74b3

openshift-ingress

multus

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ab74b3: serviceaccount "payload-processing-e2e-api-a-ab74b3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ab74b3-58649fc6cc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ab74b3-58649fc6cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ab74b3: serviceaccount "payload-processing-e2e-api-a-ab74b3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ab74b3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ab74b3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ab74b3-58649fc6cc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ab74b3-58649fc6cc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.45s (2.45s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Unhealthy

Readiness probe failed: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

ProbeError

Readiness probe error: Get "http://10.132.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-8aa282-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-8aa282-openshift-default-64c4fdc946 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-8aa282-openshift-default-64c4fdc946

SuccessfulCreate

Created pod: e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

openshift-ingress

gateway_labeler_controller

e2e-api-b-8aa282

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-8aa282

openshift-ingress

multus

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8aa282-5cfcc856b9

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8aa282: serviceaccount "payload-processing-e2e-api-b-8aa282" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-8aa282

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-8aa282

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-8aa282-5cfcc856b9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-8aa282-5cfcc856b9

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-8aa282-5cfcc856b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-8aa282: serviceaccount "payload-processing-e2e-api-b-8aa282" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab74b3-58649fc6cc-blgqv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab74b3-8f679b5cd-4kbzg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ab74b3-openshift-default-56fc6f97db-99s7t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-8aa282-554ddd4f9d-v78sh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-8aa282-5cfcc856b9-t8r22

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-8aa282-openshift-default-64c4fdc946-2hvgc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-83c318-5d96b6dbdf-r7lms

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-83c318

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-83c318: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-83c318": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-83c318, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: cf2325d8-3444-4c98-bcbe-c2e0f9ab8c78, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-83c318-8c7bcb8db-9f552

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-83c318-openshift-default-7884dbdc78-766jz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a310dd-8457c575c-7fwnk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a310dd-6466864494-wfq7f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a310dd-openshift-default-669bd4fbbb-rf2gs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ipp-a-3f01c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4

SuccessfulCreate

Created pod: e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3f01c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3f01c7

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3f01c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f01c7: serviceaccount "payload-processing-e2e-ipp-a-3f01c7" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f01c7: serviceaccount "payload-processing-e2e-ipp-a-3f01c7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3f01c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Unhealthy

Readiness probe failed: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

ProbeError

Readiness probe error: Get "http://10.132.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-b0741a-openshift-default-777bf97b98

SuccessfulCreate

Created pod: e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

openshift-ingress

deployment-controller

e2e-ipp-b-b0741a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-b0741a-openshift-default-777bf97b98 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-b0741a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-b0741a

openshift-ingress

multus

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-b0741a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-b0741a-5966484fbf from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b0741a-5966484fbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-b0741a-5966484fbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b0741a: serviceaccount "payload-processing-e2e-ipp-b-b0741a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-b0741a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-b0741a-5966484fbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-b0741a: serviceaccount "payload-processing-e2e-ipp-b-b0741a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Unhealthy

Readiness probe failed: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

ProbeError

Readiness probe error: Get "http://10.134.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-eb3d6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-eb3d6d

openshift-ingress

deployment-controller

e2e-ipp-cleanup-eb3d6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d

SuccessfulCreate

Created pod: e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

openshift-ingress

multus

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-eb3d6d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eb3d6d: serviceaccount "payload-processing-e2e-ipp-cleanup-eb3d6d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-eb3d6d: serviceaccount "payload-processing-e2e-ipp-cleanup-eb3d6d" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-eb3d6d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-eb3d6d-56bc754658-4s94t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-eb3d6d-54dd57c55-gc4ns

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-eb3d6d-openshift-default-659c55756d-clkxb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f01c7-69c8b8bd9c-dg5rq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f01c7-9bd6d7bcd-db8ck

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-3f01c7-openshift-default-7d6f4b4cc4-85ln8

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-b0741a

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-b0741a: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-b0741a": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-b0741a, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ce56855c-9b51-4ab2-a859-09effc587270, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-b0741a-5966484fbf-7pkbm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-b0741a-7b89bf4ff4-c6vn7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-b0741a-openshift-default-777bf97b98-w2h8t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-7a11e9-75b9f9685f-2nfbc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-7a11e9-6864c5c8cd-x6gvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-7a11e9-openshift-default-746748bbb8-n6t9w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-a00003-c6dc88649-28qrt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-a00003-66c855d86-wvhm5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-a00003-openshift-default-6dd4c47886-9vpgv

Killing

Stopping container istio-proxy