Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

Scheduled

Successfully assigned openshift-ingress/e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb to ip-10-0-133-152.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-msm2r to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5 to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

Scheduled

Successfully assigned openshift-ingress/e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2 to ip-10-0-140-93.ec2.internal

openshift-ingress

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2475a5c7-openshift-default-765685846d-49tkw to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-hclrp

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-hclrp to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p to ip-10-0-140-93.ec2.internal

openshift-ingress

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps to ip-10-0-140-93.ec2.internal

openshift-ingress

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv to ip-10-0-140-93.ec2.internal

openshift-ingress

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn to ip-10-0-139-173.ec2.internal

openshift-ingress

kube-auth-proxy-5948bbb55b-hznrz

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5948bbb55b-hznrz to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb to ip-10-0-139-173.ec2.internal

openshift-ingress

kube-auth-proxy-5948bbb55b-6bs6z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5948bbb55b-6bs6z to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p to ip-10-0-133-152.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799czcjgf to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9 to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5 to ip-10-0-140-93.ec2.internal

openshift-ingress

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq to ip-10-0-140-93.ec2.internal

openshift-ingress

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9 to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-2zjb7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-2zjb7 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns to ip-10-0-140-93.ec2.internal

openshift-ingress

router-default-6f8c9778b-t8sr5

Scheduled

Successfully assigned openshift-ingress/router-default-6f8c9778b-t8sr5 to ip-10-0-133-152.ec2.internal

openshift-ingress

router-default-6f8c9778b-t8sr5

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6 to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Scheduled

Successfully assigned openshift-ingress/e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c to ip-10-0-139-173.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c to ip-10-0-133-152.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7 to ip-10-0-133-152.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-n9cd4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-n9cd4 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4 to ip-10-0-140-93.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72 to ip-10-0-133-152.ec2.internal

openshift-ingress

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59 to ip-10-0-140-93.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-4r46z

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4r46z to ip-10-0-139-173.ec2.internal

openshift-ingress

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

Scheduled

Successfully assigned openshift-ingress/e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks to ip-10-0-139-173.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6f8c9778b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-6f8c9778b

FailedCreate

Error creating: pods "router-default-6f8c9778b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6f8c9778b

FailedCreate

Error creating: pods "router-default-6f8c9778b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6f8c9778b

SuccessfulCreate

Created pod: router-default-6f8c9778b-t8sr5
(x6)

openshift-ingress

kubelet

router-default-6f8c9778b-t8sr5

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6f8c9778b-t8sr5

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6f8c9778b-t8sr5

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-6f8c9778b-t8sr5

AddedInterface

Add eth0 [10.132.0.16/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6f8c9778b-t8sr5

Started

Started container router

openshift-ingress

kubelet

router-default-6f8c9778b-t8sr5

Created

Created container: router

openshift-ingress

replicaset-controller

kube-auth-proxy-5948bbb55b

SuccessfulCreate

Created pod: kube-auth-proxy-5948bbb55b-6bs6z
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5948bbb55b

FailedCreate

Error creating: pods "kube-auth-proxy-5948bbb55b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-5948bbb55b

SuccessfulCreate

Created pod: kube-auth-proxy-5948bbb55b-hznrz

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5948bbb55b from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-6bs6z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-hznrz

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-4r46z

openshift-ingress

multus

kube-auth-proxy-5948bbb55b-6bs6z

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5948bbb55b-hznrz

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4r46z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-4r46z

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-hznrz

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.913s (2.913s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-6bs6z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.869s (2.869s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-6bs6z

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-hznrz

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-hznrz

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5948bbb55b-6bs6z

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4r46z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.581s (3.581s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4r46z

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4r46z

Started

Started container discovery

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799czcjgf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.543s (2.543s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-n9cd4

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-n9cd4

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-n9cd4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-n9cd4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.394s (2.394s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-n9cd4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-n9cd4

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-4r46z

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-4r46z

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-msm2r

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-msm2r

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.382s (2.382s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-hclrp

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zjb7

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-hclrp

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hclrp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-2zjb7

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-2zjb7

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hclrp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zjb7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hclrp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.248s (2.248s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zjb7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zjb7

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.514s (2.514s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-hclrp

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Created

Created container: istio-proxy
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-msm2r

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-1e223f-openshift-default-7b4bd9d788

SuccessfulCreate

Created pod: e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1e223f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1e223f

openshift-ingress

deployment-controller

e2e-inf-a-1e223f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1e223f-openshift-default-7b4bd9d788 from 0 to 1

openshift-ingress

multus

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1e223f-74ccc5b895

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1e223f-74ccc5b895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1e223f: serviceaccount "payload-processing-e2e-inf-a-1e223f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1e223f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1e223f-57b684cd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1e223f: serviceaccount "payload-processing-e2e-inf-a-1e223f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1e223f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1e223f-74ccc5b895 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1e223f-74ccc5b895

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-e917b0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-e917b0-openshift-default-5d8cb6698b from 0 to 1

openshift-ingress

deployment-controller

e2e-ait-f09b7dee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f09b7dee-openshift-default-86b54b7d44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-e917b0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-e917b0

openshift-ingress

replicaset-controller

e2e-autores-e917b0-openshift-default-5d8cb6698b

SuccessfulCreate

Created pod: e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

openshift-ingress

replicaset-controller

e2e-ait-f09b7dee-openshift-default-86b54b7d44

SuccessfulCreate

Created pod: e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

openshift-ingress

gateway_labeler_controller

e2e-ait-f09b7dee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f09b7dee

openshift-ingress

multus

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f09b7dee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f09b7dee-7c58b9655 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f09b7dee-7c58b9655

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f09b7dee: serviceaccount "payload-processing-e2e-ait-f09b7dee" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f09b7dee-7c58b9655

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f09b7dee-7c58b9655-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f09b7dee: serviceaccount "payload-processing-e2e-ait-f09b7dee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f09b7dee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e917b0-5b6f44888f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-e917b0-5b6f44888f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e917b0: serviceaccount "payload-processing-e2e-autores-e917b0" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-e917b0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-e917b0-65bd5967b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e917b0-65bd5967b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-e917b0-65bd5967b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-e917b0-65bd5967b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-e917b0: serviceaccount "payload-processing-e2e-autores-e917b0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-e917b0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-e917b0-5b6f44888f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-e917b0-5b6f44888f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

openshift-ingress

multus

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.456s (2.456s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.504s (2.504s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Unhealthy

Readiness probe failed: Get "http://10.134.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

ProbeError

Readiness probe error: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

ProbeError

Readiness probe error: Get "http://10.134.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Unhealthy

Readiness probe failed: Get "http://10.133.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5e5923

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5e5923

openshift-ingress

deployment-controller

e2e-inf-b-5e5923-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5e5923-openshift-default-574c9f5cf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-5e5923-openshift-default-574c9f5cf4

SuccessfulCreate

Created pod: e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb
(x2)

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5e5923

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5e5923-6877768669 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5e5923

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5e5923-97498fbb6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5e5923-6877768669

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5e5923-6877768669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5e5923: serviceaccount "payload-processing-e2e-inf-b-5e5923" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5e5923: serviceaccount "payload-processing-e2e-inf-b-5e5923" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5e5923-6877768669

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv
(x5)

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

ProbeError

Startup probe error: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Unhealthy

Startup probe failed: Get "http://10.133.0.62:15021/healthz/ready": dial tcp 10.133.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f09b7dee-7b8895b69d-hv98p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f09b7dee-7c58b9655-5746p

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-dbdca9a8-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-dbdca9a8-gw

openshift-ingress

kubelet

e2e-ait-f09b7dee-openshift-default-86b54b7d44-wqw8p

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996

SuccessfulCreate

Created pod: e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

openshift-ingress

deployment-controller

e2e-migrate-dbdca9a8-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996 from 0 to 1

openshift-ingress

multus

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dbdca9a8: serviceaccount "payload-processing-e2e-migrate-dbdca9a8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-dbdca9a8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-dbdca9a8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-dbdca9a8: serviceaccount "payload-processing-e2e-migrate-dbdca9a8" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

openshift-ingress

kubelet

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-dbdca9a8-6667dbc5f4-nqc72

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-dbdca9a8-65846f6b6-x6c5n

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-dbdca9a8-gw-openshift-default-f9d5b996-z6d6d

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-aea1bdeb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-aea1bdeb

openshift-ingress

replicaset-controller

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78

SuccessfulCreate

Created pod: e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

openshift-ingress

deployment-controller

e2e-ait-aea1bdeb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-aea1bdeb-openshift-default-6c8bfccf78 from 0 to 1

openshift-ingress

multus

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aea1bdeb-5477696677

SuccessfulCreate

Created pod: payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

openshift-ingress

deployment-controller

payload-processing-e2e-ait-aea1bdeb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-aea1bdeb-5477696677 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aea1bdeb: serviceaccount "payload-processing-e2e-ait-aea1bdeb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-aea1bdeb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-aea1bdeb-74c954f554 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-aea1bdeb-5477696677

FailedCreate

Error creating: pods "payload-processing-e2e-ait-aea1bdeb-5477696677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-aea1bdeb: serviceaccount "payload-processing-e2e-ait-aea1bdeb" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-aea1bdeb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-aea1bdeb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-aea1bdeb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-aea1bdeb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0c62dc9c-57fa-42d2-af00-ef10ca1953d5, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-aea1bdeb-5477696677-cdfvk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-aea1bdeb-74c954f554-l545c

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-ace3fa44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-ace3fa44

openshift-ingress

kubelet

e2e-ait-aea1bdeb-openshift-default-6c8bfccf78-29plm

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-ace3fa44-openshift-default-999c5f4d8

SuccessfulCreate

Created pod: e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

openshift-ingress

deployment-controller

e2e-derive-ace3fa44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-ace3fa44-openshift-default-999c5f4d8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ace3fa44-796cdc8ff7

FailedCreate

Error creating: pods "payload-processing-e2e-derive-ace3fa44-796cdc8ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ace3fa44: serviceaccount "payload-processing-e2e-derive-ace3fa44" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-ace3fa44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-ace3fa44-796cdc8ff7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-ace3fa44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-ace3fa44: serviceaccount "payload-processing-e2e-derive-ace3fa44" not found

openshift-ingress

multus

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

openshift-ingress

kubelet

payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-ace3fa44-796cdc8ff7

SuccessfulCreate

Created pod: payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

openshift-ingress

kubelet

payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-ace3fa44-796cdc8ff7-4hskg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-ace3fa44-6cf676c66b-c8hgd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-ace3fa44-openshift-default-999c5f4d8-2p6ks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-e917b0-5b6f44888f-qjxvc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-e917b0-65bd5967b6-wtsgp

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-e917b0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-e917b0: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-e917b0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-e917b0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5aef2c5f-8957-48a7-b3e4-a8de81c76ba9, UID in object meta:

openshift-ingress

gateway_labeler_controller

e2e-explicit-0f93fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-0f93fa

openshift-ingress

replicaset-controller

e2e-explicit-0f93fa-openshift-default-fd5bd98d8

SuccessfulCreate

Created pod: e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

openshift-ingress

kubelet

e2e-autores-e917b0-openshift-default-5d8cb6698b-vdq8c

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-0f93fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-0f93fa-openshift-default-fd5bd98d8 from 0 to 1

openshift-ingress

multus

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-0f93fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-0f93fa-7f77b5c849 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-0f93fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-0f93fa-647666cd78 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0f93fa-7f77b5c849

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-0f93fa-7f77b5c849-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0f93fa: serviceaccount "payload-processing-e2e-explicit-0f93fa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0f93fa-647666cd78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0f93fa-647666cd78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-0f93fa-647666cd78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0f93fa: serviceaccount "payload-processing-e2e-explicit-0f93fa" not found

openshift-ingress

multus

payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0f93fa-7f77b5c849

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": read tcp 10.134.0.2:38858->10.134.0.38:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": read tcp 10.134.0.2:38858->10.134.0.38:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-2475a5c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2475a5c7

openshift-ingress

multus

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-2475a5c7-openshift-default-765685846d

SuccessfulCreate

Created pod: e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

openshift-ingress

deployment-controller

e2e-mt-2475a5c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2475a5c7-openshift-default-765685846d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2475a5c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2475a5c7: serviceaccount "payload-processing-e2e-mt-2475a5c7" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2475a5c7: serviceaccount "payload-processing-e2e-mt-2475a5c7" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2475a5c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

openshift-ingress

kubelet

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Unhealthy

Readiness probe failed: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

ProbeError

Readiness probe error: Get "http://10.133.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0f93fa-647666cd78-wn89x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0f93fa-7f77b5c849-c9z7f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1e223f-74ccc5b895-z579c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1e223f-57b684cd6-j66dl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-0f93fa-openshift-default-fd5bd98d8-mhm4s

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-6a8ecc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-6a8ecc

openshift-ingress

deployment-controller

e2e-noten-6a8ecc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-6a8ecc-openshift-default-8c58657fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-6a8ecc-openshift-default-8c58657fb

SuccessfulCreate

Created pod: e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

openshift-ingress

multus

e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1e223f-openshift-default-7b4bd9d788-5f6pn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-2475a5c7-6dbc7ff7b9-5s9ns

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2475a5c7-7f59d55d6-8d2fh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-5e5923

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-5e5923: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-5e5923": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-5e5923, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7a82fd6f-6152-497a-ac67-973a271406e6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5e5923-97498fbb6-8nhv6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5e5923-6877768669-wx2xv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-2475a5c7-openshift-default-765685846d-49tkw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-5e5923-openshift-default-574c9f5cf4-frltb

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-283adb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-283adb-openshift-default-969d8f876 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-283adb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-283adb

openshift-ingress

replicaset-controller

e2e-shared-a-w3-283adb-openshift-default-969d8f876

SuccessfulCreate

Created pod: e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

openshift-ingress

deployment-controller

e2e-shared-a-w2-a3f43f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-283adb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-283adb-84db579cff from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-283adb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-283adb: serviceaccount "payload-processing-e2e-shared-a-w3-283adb" not found

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-a3f43f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-a3f43f

openshift-ingress

replicaset-controller

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d

SuccessfulCreate

Created pod: e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-283adb-84db579cff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-283adb-84db579cff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-283adb: serviceaccount "payload-processing-e2e-shared-a-w3-283adb" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-283adb-84db579cff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

Created

Created container: payload-processing

openshift-ingress

multus

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-6a8ecc-openshift-default-8c58657fb-wqlfz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-a3f43f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-a3f43f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-a3f43f-5988f69787 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a3f43f: serviceaccount "payload-processing-e2e-shared-a-w2-a3f43f" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-a3f43f: serviceaccount "payload-processing-e2e-shared-a-w2-a3f43f" not found

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

ProbeError

Readiness probe error: Get "http://10.134.0.45:15021/healthz/ready": read tcp 10.134.0.2:35158->10.134.0.45:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Unhealthy

Readiness probe failed: Get "http://10.134.0.45:15021/healthz/ready": read tcp 10.134.0.2:35158->10.134.0.45:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-fe6606

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-fe6606

openshift-ingress

replicaset-controller

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b

SuccessfulCreate

Created pod: e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

openshift-ingress

deployment-controller

e2e-shared-b-w3-fe6606-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-fe6606: serviceaccount "payload-processing-e2e-shared-b-w3-fe6606" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4

SuccessfulCreate

Created pod: e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-fe6606

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-fe6606-6656c9477f from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-b-w2-590823-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-590823

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-590823

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-fe6606

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-fe6606: serviceaccount "payload-processing-e2e-shared-b-w3-fe6606" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-590823

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-590823-7fb946cc6f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-590823

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-590823: serviceaccount "payload-processing-e2e-shared-b-w2-590823" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-590823: serviceaccount "payload-processing-e2e-shared-b-w2-590823" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-6a4af97c-openshift-default-5f788ff64

SuccessfulCreate

Created pod: e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

openshift-ingress

deployment-controller

e2e-mt-6a4af97c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6a4af97c-openshift-default-5f788ff64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-6a4af97c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6a4af97c

openshift-ingress

multus

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6a4af97c-85f89b5f69

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6a4af97c-85f89b5f69

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6a4af97c-85f89b5f69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6a4af97c: serviceaccount "payload-processing-e2e-mt-6a4af97c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6a4af97c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6a4af97c: serviceaccount "payload-processing-e2e-mt-6a4af97c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6a4af97c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6a4af97c-85f89b5f69 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

ProbeError

Startup probe error: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

Unhealthy

Startup probe failed: Get "http://10.133.0.80:15021/healthz/ready": dial tcp 10.133.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6a4af97c-65b5566cd6-k8wz5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6a4af97c-85f89b5f69-4jlvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-6a4af97c-openshift-default-5f788ff64-zldzd

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-ab8d88-openshift-default-7ff5bb4466

SuccessfulCreate

Created pod: e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

openshift-ingress

deployment-controller

e2e-api-a-ab8d88-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-ab8d88-openshift-default-7ff5bb4466 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-ab8d88

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-ab8d88

openshift-ingress

multus

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ab8d88: serviceaccount "payload-processing-e2e-api-a-ab8d88" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-ab8d88

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ab8d88-7997c466c7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-ab8d88-7997c466c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-ab8d88: serviceaccount "payload-processing-e2e-api-a-ab8d88" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-ab8d88

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-ab8d88-7997c466c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-ab8d88-7997c466c7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

openshift-ingress

multus

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-3f4a7d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-3f4a7d-openshift-default-6475bfd948 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-3f4a7d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-3f4a7d
(x5)

openshift-ingress

kubelet

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

ProbeError

Startup probe error: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-api-b-3f4a7d-openshift-default-6475bfd948

SuccessfulCreate

Created pod: e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq
(x5)

openshift-ingress

kubelet

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

Unhealthy

Startup probe failed: Get "http://10.133.0.82:15021/healthz/ready": dial tcp 10.133.0.82:15021: connect: connection refused

openshift-ingress

multus

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-3f4a7d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3f4a7d: serviceaccount "payload-processing-e2e-api-b-3f4a7d" not found

openshift-ingress

multus

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-3f4a7d: serviceaccount "payload-processing-e2e-api-b-3f4a7d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-3f4a7d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-3f4a7d-67c959496b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-ab8d88-57b6f45f98-5jsps

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-ab8d88-7997c466c7-tt72p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-ab8d88-openshift-default-7ff5bb4466-q2fks

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-3f4a7d-5ccb9f8d95-8hnxb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-3f4a7d-67c959496b-kv777

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-3f4a7d-openshift-default-6475bfd948-t9dhq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-a3f43f-5988f69787-dcrq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-a3f43f-699b75f7b6-kmr4d

Unhealthy

Readiness probe failed: dial tcp 10.132.0.59:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-a3f43f-openshift-default-6b9599474d-x6kg5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-590823-7fb946cc6f-rs6vl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-590823-8bd96d5f8-8rtmj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-590823-openshift-default-6cb6c9c9c4-p76rz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb

SuccessfulCreate

Created pod: e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

openshift-ingress

deployment-controller

e2e-ipp-a-610d01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-610d01-openshift-default-56cf6ffcdb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-610d01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-610d01

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-610d01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-610d01-564f88b77 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-610d01: serviceaccount "payload-processing-e2e-ipp-a-610d01" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-610d01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-610d01-564f88b77

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-610d01-564f88b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-610d01: serviceaccount "payload-processing-e2e-ipp-a-610d01" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-610d01-564f88b77

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Unhealthy

Readiness probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

ProbeError

Readiness probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Unhealthy

Startup probe failed: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

ProbeError

Startup probe error: Get "http://10.133.0.86:15021/healthz/ready": dial tcp 10.133.0.86:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2db0a6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2db0a6

openshift-ingress

multus

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8

SuccessfulCreate

Created pod: e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

openshift-ingress

deployment-controller

e2e-ipp-b-2db0a6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2db0a6-openshift-default-55c4b657c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2db0a6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2db0a6-678b564949 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2db0a6: serviceaccount "payload-processing-e2e-ipp-b-2db0a6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2db0a6-678b564949

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2db0a6-678b564949

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2db0a6-678b564949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2db0a6: serviceaccount "payload-processing-e2e-ipp-b-2db0a6" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2db0a6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6 from 0 to 1

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-90dee1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-90dee1

openshift-ingress

deployment-controller

e2e-ipp-cleanup-90dee1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-90dee1: serviceaccount "payload-processing-e2e-ipp-cleanup-90dee1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-90dee1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-90dee1-647b8884c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-90dee1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-90dee1: serviceaccount "payload-processing-e2e-ipp-cleanup-90dee1" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Unhealthy

Startup probe failed: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

ProbeError

Startup probe error: Get "http://10.133.0.89:15021/healthz/ready": dial tcp 10.133.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-90dee1-647b8884c-q2gp4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-90dee1-5b78d889f8-sbw6c

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-90dee1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-90dee1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-90dee1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-90dee1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f66fb492-c59d-48c8-a2b2-39f88e4493fb, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-90dee1-openshift-default-68d6b75fb8-9t6q9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-610d01-b85b48fb6-v22cg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-610d01-564f88b77-5pwnl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-610d01-openshift-default-56cf6ffcdb-jwt8b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-2db0a6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-2db0a6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-2db0a6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-2db0a6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 52677ad4-f733-47fc-97a0-c9b74147c718, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2db0a6-678b564949-7rx6t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2db0a6-76644d9d6-lsgp7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2db0a6-openshift-default-55c4b657c8-sbx59

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-283adb-65598dbf8-vvvh2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-283adb-84db579cff-2tzzx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-283adb-openshift-default-969d8f876-fbbmp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-fe6606-6656c9477f-dvgp6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-fe6606

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fe6606: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-fe6606": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-fe6606, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: acc059ec-87e5-483f-826e-3d231a7e1a8d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-fe6606-d64b8f86b-9qqx8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-fe6606-openshift-default-6fc4df845b-6r2q9

Killing

Stopping container istio-proxy