Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59 to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf to ip-10-0-133-57.ec2.internal

openshift-ingress

kube-auth-proxy-77d6c74c55-smc56

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-77d6c74c55-smc56 to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq to ip-10-0-133-57.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-gv6ws to ip-10-0-138-164.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p to ip-10-0-138-164.ec2.internal

openshift-ingress

kube-auth-proxy-77d6c74c55-45hwl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-77d6c74c55-45hwl to ip-10-0-140-162.ec2.internal

openshift-ingress

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Scheduled

Successfully assigned openshift-ingress/e2e-ait-3c452994-openshift-default-5c8c875586-l7r72 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-5cc6cd444b-76zbd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5cc6cd444b-76zbd to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-42733177-75f4c5894-pcsmn to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw to ip-10-0-138-164.ec2.internal

openshift-ingress

e2e-derive-42733177-openshift-default-76f8d864-f994z

Scheduled

Successfully assigned openshift-ingress/e2e-derive-42733177-openshift-default-76f8d864-f994z to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6 to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-687dbb6cf6-wsscd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-687dbb6cf6-wsscd to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b71fef06-openshift-default-5496664854-rglmd to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5 to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf to ip-10-0-138-164.ec2.internal

openshift-ingress

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7 to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg to ip-10-0-133-57.ec2.internal

openshift-ingress

router-default-ff76cddc9-wcv8g

Scheduled

Successfully assigned openshift-ingress/router-default-ff76cddc9-wcv8g to ip-10-0-133-57.ec2.internal

openshift-ingress

router-default-ff76cddc9-wcv8g

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5 to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227 to ip-10-0-138-164.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-pz96k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-pz96k to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2 to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6 to ip-10-0-133-57.ec2.internal

openshift-ingress

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b to ip-10-0-133-57.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp to ip-10-0-138-164.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv to ip-10-0-138-164.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-ff76cddc9 from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-ff76cddc9

FailedCreate

Error creating: pods "router-default-ff76cddc9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-ff76cddc9

FailedCreate

Error creating: pods "router-default-ff76cddc9-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-ff76cddc9

SuccessfulCreate

Created pod: router-default-ff76cddc9-wcv8g
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-ff76cddc9-wcv8g

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-ff76cddc9-wcv8g

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-ff76cddc9-wcv8g

Started

Started container router

openshift-ingress

kubelet

router-default-ff76cddc9-wcv8g

Created

Created container: router

openshift-ingress

kubelet

router-default-ff76cddc9-wcv8g

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine

openshift-ingress

multus

router-default-ff76cddc9-wcv8g

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-45hwl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-77d6c74c55-45hwl

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-77d6c74c55-smc56

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-smc56

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-77d6c74c55 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-77d6c74c55

SuccessfulCreate

Created pod: kube-auth-proxy-77d6c74c55-45hwl

openshift-ingress

replicaset-controller

kube-auth-proxy-77d6c74c55

SuccessfulCreate

Created pod: kube-auth-proxy-77d6c74c55-smc56
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-77d6c74c55

FailedCreate

Error creating: pods "kube-auth-proxy-77d6c74c55-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-45hwl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-45hwl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-45hwl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.667s (2.667s including waiting). Image size: 265120132 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-pz96k

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-smc56

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.684s (3.684s including waiting). Image size: 265120132 bytes.

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-pz96k

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-smc56

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-77d6c74c55-smc56

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pz96k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pz96k

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pz96k

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-pz96k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.103s (3.103s including waiting). Image size: 181126104 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.376s (3.376s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-m6j8p

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-gv6ws

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5cc6cd444b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

FailedCreate

Error creating: pods "payload-processing-5cc6cd444b-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

FailedCreate

Error creating: pods "payload-pre-processing-687dbb6cf6-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5cc6cd444b

SuccessfulCreate

Created pod: payload-processing-5cc6cd444b-76zbd

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-687dbb6cf6 from 0 to 1

openshift-ingress

kubelet

payload-processing-5cc6cd444b-76zbd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wsscd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5cc6cd444b-76zbd

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-687dbb6cf6-wsscd

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-687dbb6cf6

SuccessfulCreate

Created pod: payload-pre-processing-687dbb6cf6-wsscd

openshift-ingress

kubelet

payload-processing-5cc6cd444b-76zbd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wsscd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wsscd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-687dbb6cf6-wsscd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.902s (2.902s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-76zbd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.706s (2.706s including waiting). Image size: 165907129 bytes.

openshift-ingress

kubelet

payload-processing-5cc6cd444b-76zbd

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-gv6ws

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ait-b71fef06

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b71fef06

openshift-ingress

replicaset-controller

e2e-ait-b71fef06-openshift-default-5496664854

SuccessfulCreate

Created pod: e2e-ait-b71fef06-openshift-default-5496664854-rglmd

openshift-ingress

deployment-controller

e2e-ait-b71fef06-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b71fef06-openshift-default-5496664854 from 0 to 1

openshift-ingress

multus

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.594s (2.594s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b71fef06-76f9f8686

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b71fef06-76f9f8686

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b71fef06-76f9f8686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b71fef06: serviceaccount "payload-processing-e2e-ait-b71fef06" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b71fef06

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b71fef06-76f9f8686 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b71fef06-6645cd5984

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b71fef06-6645cd5984

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b71fef06-6645cd5984-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b71fef06: serviceaccount "payload-processing-e2e-ait-b71fef06" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b71fef06

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b71fef06-6645cd5984 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b71fef06-6645cd5984-67n7h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b71fef06-76f9f8686-9vrf6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b71fef06-openshift-default-5496664854-rglmd

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-9fd4a294-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-9fd4a294-gw

openshift-ingress

deployment-controller

e2e-migrate-9fd4a294-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-9fd4a294-gw-openshift-default-579c64847b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b

SuccessfulCreate

Created pod: e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-9fd4a294

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-9fd4a294-b5dc4f745 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9fd4a294-757d758744

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

openshift-ingress

kubelet

payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9fd4a294-b5dc4f745

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9fd4a294-b5dc4f745

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-9fd4a294-b5dc4f745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9fd4a294: serviceaccount "payload-processing-e2e-migrate-9fd4a294" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9fd4a294-757d758744

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-9fd4a294-757d758744-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9fd4a294: serviceaccount "payload-processing-e2e-migrate-9fd4a294" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-9fd4a294

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-9fd4a294-757d758744 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Unhealthy

Readiness probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

ProbeError

Readiness probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

ProbeError

Startup probe error: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Unhealthy

Startup probe failed: Get "http://10.132.0.39:15021/healthz/ready": dial tcp 10.132.0.39:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-9fd4a294-b5dc4f745-8lxlp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9fd4a294-757d758744-h6nnp

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-3c452994-openshift-default-5c8c875586

SuccessfulCreate

Created pod: e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-3c452994

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-3c452994

openshift-ingress

deployment-controller

e2e-ait-3c452994-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-3c452994-openshift-default-5c8c875586 from 0 to 1

openshift-ingress

multus

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-9fd4a294-gw-openshift-default-579c64847b-hzw7k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-3c452994

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-3c452994-699cb69d48 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3c452994-846b4b5798

FailedCreate

Error creating: pods "payload-processing-e2e-ait-3c452994-846b4b5798-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3c452994: serviceaccount "payload-processing-e2e-ait-3c452994" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-3c452994-846b4b5798

SuccessfulCreate

Created pod: payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

openshift-ingress

deployment-controller

payload-processing-e2e-ait-3c452994

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-3c452994-846b4b5798 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3c452994-699cb69d48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-3c452994-699cb69d48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-3c452994-699cb69d48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-3c452994: serviceaccount "payload-processing-e2e-ait-3c452994" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

ProbeError

Startup probe error: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Unhealthy

Startup probe failed: Get "http://10.132.0.42:15021/healthz/ready": dial tcp 10.132.0.42:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-3c452994-699cb69d48-th7js

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-3c452994-846b4b5798-9tdb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-42733177-openshift-default-76f8d864-f994z

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-derive-42733177

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-42733177

openshift-ingress

deployment-controller

e2e-derive-42733177-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-42733177-openshift-default-76f8d864 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-42733177-openshift-default-76f8d864

SuccessfulCreate

Created pod: e2e-derive-42733177-openshift-default-76f8d864-f994z

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-42733177-75f4c5894

SuccessfulCreate

Created pod: payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

openshift-ingress

kubelet

payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-3c452994-openshift-default-5c8c875586-l7r72

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-42733177-75f4c5894

FailedCreate

Error creating: pods "payload-processing-e2e-derive-42733177-75f4c5894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-42733177: serviceaccount "payload-processing-e2e-derive-42733177" not found

openshift-ingress

multus

payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-42733177-d9c58f5b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-42733177-d9c58f5b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-42733177: serviceaccount "payload-processing-e2e-derive-42733177" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-42733177-d9c58f5b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

openshift-ingress

deployment-controller

payload-processing-e2e-derive-42733177

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-42733177-75f4c5894 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-42733177

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-42733177-d9c58f5b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

Unhealthy

Readiness probe failed: dial tcp 10.132.0.47:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-42733177-75f4c5894-pcsmn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-42733177-d9c58f5b-k4q6l

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-derive-42733177-openshift-default-76f8d864-f994z

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-d0e37f3c-openshift-default-6c6446cd68

SuccessfulCreate

Created pod: e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

openshift-ingress

gateway_labeler_controller

e2e-mt-d0e37f3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-d0e37f3c

openshift-ingress

deployment-controller

e2e-mt-d0e37f3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-d0e37f3c-openshift-default-6c6446cd68 from 0 to 1

openshift-ingress

multus

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-d0e37f3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-d0e37f3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-d0e37f3c-c6c58b4fd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d0e37f3c: serviceaccount "payload-processing-e2e-mt-d0e37f3c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

openshift-ingress

multus

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-d0e37f3c: serviceaccount "payload-processing-e2e-mt-d0e37f3c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

ProbeError

Readiness probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Unhealthy

Readiness probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-d0e37f3c-65f6d68b6d-w8xsx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-d0e37f3c-c6c58b4fd-vrqw2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-d0e37f3c-openshift-default-6c6446cd68-6z7qf

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-mt-2dd70051

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2dd70051

openshift-ingress

deployment-controller

e2e-mt-2dd70051-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2dd70051-openshift-default-745d7d84bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-2dd70051-openshift-default-745d7d84bd

SuccessfulCreate

Created pod: e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

openshift-ingress

kubelet

payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2dd70051

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2dd70051-65dd6867cd from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2dd70051-65dd6867cd

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2dd70051-65dd6867cd

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2dd70051-65dd6867cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2dd70051: serviceaccount "payload-processing-e2e-mt-2dd70051" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2dd70051: serviceaccount "payload-processing-e2e-mt-2dd70051" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2dd70051

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2dd70051-bfbcf4556 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": read tcp 10.132.0.2:41106->10.132.0.52:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": read tcp 10.132.0.2:41106->10.132.0.52:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2dd70051-bfbcf4556-pmhbg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2dd70051-65dd6867cd-7nlw5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-2dd70051-openshift-default-745d7d84bd-n8mnq

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-d9fd50-openshift-default-647f488c6b

SuccessfulCreate

Created pod: e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

openshift-ingress

gateway_labeler_controller

e2e-inf-a-d9fd50

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-d9fd50

openshift-ingress

deployment-controller

e2e-inf-a-d9fd50-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-d9fd50-openshift-default-647f488c6b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-d9fd50

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-d9fd50-7fd8cbd678 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d9fd50: serviceaccount "payload-processing-e2e-inf-a-d9fd50" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-d9fd50

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-d9fd50: serviceaccount "payload-processing-e2e-inf-a-d9fd50" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9bf2ee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9bf2ee

openshift-ingress

multus

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-9bf2ee-openshift-default-5c599b4686

SuccessfulCreate

Created pod: e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

openshift-ingress

deployment-controller

e2e-inf-b-9bf2ee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9bf2ee-openshift-default-5c599b4686 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9bf2ee: serviceaccount "payload-processing-e2e-inf-b-9bf2ee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9bf2ee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9bf2ee: serviceaccount "payload-processing-e2e-inf-b-9bf2ee" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9bf2ee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

Unhealthy

Readiness probe failed: dial tcp 10.134.0.48:9004: connect: connection refused

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-d9fd50-7fd8cbd678-fpxwx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-d9fd50-6c95d4bb96-vgggb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-d9fd50-openshift-default-647f488c6b-f766b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9bf2ee-6b64bfc65b-fd86w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9bf2ee-5b8f576dcd-78pvw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-9bf2ee-openshift-default-5c599b4686-pzbm4

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-ee8397

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ee8397

openshift-ingress

deployment-controller

e2e-api-a-ee8397-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ee8397-openshift-default-7db45b9d7d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-ee8397-openshift-default-7db45b9d7d

SuccessfulCreate

Created pod: e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

openshift-ingress

multus

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ee8397-fb5988d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

openshift-ingress

kubelet

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ee8397-fb5988d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ee8397-fb5988d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ee8397: serviceaccount "payload-processing-e2e-api-a-ee8397" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ee8397-6d5f96c898

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ee8397-6d5f96c898-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ee8397: serviceaccount "payload-processing-e2e-api-a-ee8397" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ee8397

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ee8397-fb5988d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ee8397-6d5f96c898

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ee8397

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ee8397-6d5f96c898 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-074f3a-openshift-default-85b85c868d

SuccessfulCreate

Created pod: e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

openshift-ingress

multus

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-074f3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-074f3a

openshift-ingress

deployment-controller

e2e-api-b-074f3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-074f3a-openshift-default-85b85c868d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-074f3a: serviceaccount "payload-processing-e2e-api-b-074f3a" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-074f3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-074f3a-7bc49454fb from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-074f3a-7bc49454fb

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-074f3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-074f3a-6d94749bb4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-074f3a-7bc49454fb

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-074f3a-7bc49454fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-074f3a: serviceaccount "payload-processing-e2e-api-b-074f3a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

openshift-ingress

kubelet

payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

Unhealthy

Readiness probe failed: dial tcp 10.132.0.64:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ee8397-6d5f96c898-gw227

Unhealthy

Readiness probe failed: dial tcp 10.134.0.51:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ee8397-fb5988d-87htx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-ee8397-openshift-default-7db45b9d7d-64njt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-074f3a-7bc49454fb-9hf4s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-074f3a-6d94749bb4-dpp89

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-b439d9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-b439d9

openshift-ingress

kubelet

e2e-api-b-074f3a-openshift-default-85b85c868d-8fw59

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-b439d9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-b439d9-openshift-default-bf4d64d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-b439d9-openshift-default-bf4d64d8

SuccessfulCreate

Created pod: e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

openshift-ingress

multus

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-b439d9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-b439d9-68c89b7cf4 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-b439d9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-b439d9-597656f784 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-b439d9-597656f784

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-b439d9-597656f784

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-b439d9-597656f784-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-b439d9: serviceaccount "payload-processing-e2e-shared-a-b439d9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-b439d9-68c89b7cf4

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-b439d9-68c89b7cf4

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-b439d9-68c89b7cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-b439d9: serviceaccount "payload-processing-e2e-shared-a-b439d9" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

Unhealthy

Readiness probe failed: dial tcp 10.132.0.69:9004: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-7076b1-openshift-default-f54b8559b

SuccessfulCreate

Created pod: e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

openshift-ingress

deployment-controller

e2e-shared-b-7076b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-7076b1-openshift-default-f54b8559b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-7076b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-7076b1

openshift-ingress

multus

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-7076b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-7076b1-649fdfdd5d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-7076b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-7076b1-7757459bc6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-7076b1: serviceaccount "payload-processing-e2e-shared-b-7076b1" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-7076b1-649fdfdd5d

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-7076b1-649fdfdd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-7076b1: serviceaccount "payload-processing-e2e-shared-b-7076b1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-7076b1-649fdfdd5d

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x3)

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-7aec84-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7aec84-openshift-default-8ffcf78c8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8

SuccessfulCreate

Created pod: e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7aec84

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7aec84

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7aec84

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7aec84-6b6f97745d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7aec84

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7aec84-6b6f97745d

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7aec84-6b6f97745d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7aec84: serviceaccount "payload-processing-e2e-ipp-a-7aec84" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7aec84-6b6f97745d

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7aec84: serviceaccount "payload-processing-e2e-ipp-a-7aec84" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-35d85b-openshift-default-745f955c6b

SuccessfulCreate

Created pod: e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

openshift-ingress

multus

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-35d85b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-35d85b

openshift-ingress

deployment-controller

e2e-ipp-b-35d85b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-35d85b-openshift-default-745f955c6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-35d85b-56df996566

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-35d85b-56df996566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-35d85b: serviceaccount "payload-processing-e2e-ipp-b-35d85b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-35d85b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-35d85b-56df996566 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-35d85b: serviceaccount "payload-processing-e2e-ipp-b-35d85b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-35d85b-56df996566

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-35d85b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

openshift-ingress

deployment-controller

e2e-ipp-cleanup-d4bcd2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-d4bcd2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-d4bcd2

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-d4bcd2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d4bcd2: serviceaccount "payload-processing-e2e-ipp-cleanup-d4bcd2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-d4bcd2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-d4bcd2: serviceaccount "payload-processing-e2e-ipp-cleanup-d4bcd2" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

Unhealthy

Readiness probe failed: dial tcp 10.134.0.61:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-d4bcd2-7c7765d47b-vb9qm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-d4bcd2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4bcd2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-d4bcd2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4bcd2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3faf4451-58ea-457e-a74d-a96545801600, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-d4bcd2-694475d9b6-spntv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-d4bcd2-openshift-default-778c5f58b-2l969

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7aec84-6b6f97745d-mzcg6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7aec84-cffbb6b48-6zjnm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-7aec84-openshift-default-8ffcf78c8-kzst5

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-35d85b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-35d85b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-35d85b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-35d85b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 229fe062-62b4-4f62-b370-a3f09e0f4f44, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-35d85b-56df996566-58qgt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-35d85b-6ff97f5fb-kf4zf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-35d85b-openshift-default-745f955c6b-d2mvp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-b439d9-68c89b7cf4-2fg84

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-b439d9-597656f784-tt9j5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-b439d9-openshift-default-bf4d64d8-9nrqf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-7076b1-7757459bc6-d5lbt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-7076b1-649fdfdd5d-c5qgd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-7076b1-openshift-default-f54b8559b-kqxm7

Killing

Stopping container istio-proxy