Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-5b54b7fbb7-7wzmf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-7wzmf to ip-10-0-133-208.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-sjdj9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-sjdj9 to ip-10-0-137-53.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-fnzdk to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96 to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb to ip-10-0-133-208.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4 to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6 to ip-10-0-130-202.ec2.internal

openshift-ingress

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4 to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7 to ip-10-0-130-202.ec2.internal

openshift-ingress

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2 to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2 to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d to ip-10-0-130-202.ec2.internal

openshift-ingress

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2 to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6 to ip-10-0-133-208.ec2.internal

openshift-ingress

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8 to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9 to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-21316764-openshift-default-fb968c688-gfrtn to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5 to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

Scheduled

Successfully assigned openshift-ingress/e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8 to ip-10-0-130-202.ec2.internal

openshift-ingress

kube-auth-proxy-66cb58b9b9-2kghf

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66cb58b9b9-2kghf to ip-10-0-137-53.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-nnn7m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-nnn7m to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-rvwwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-rvwwf to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw to ip-10-0-133-208.ec2.internal

openshift-ingress

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Scheduled

Successfully assigned openshift-ingress/e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64 to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg to ip-10-0-137-53.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k to ip-10-0-130-202.ec2.internal

openshift-ingress

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75 to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh to ip-10-0-130-202.ec2.internal

openshift-ingress

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Scheduled

Successfully assigned openshift-ingress/e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj to ip-10-0-130-202.ec2.internal

openshift-ingress

router-default-676fd4f68-q9ztc

Scheduled

Successfully assigned openshift-ingress/router-default-676fd4f68-q9ztc to ip-10-0-133-208.ec2.internal

openshift-ingress

router-default-676fd4f68-q9ztc

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

openshift-ingress

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8 to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt to ip-10-0-133-208.ec2.internal

openshift-ingress

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm to ip-10-0-133-208.ec2.internal

openshift-ingress

kube-auth-proxy-66cb58b9b9-xjgxc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-66cb58b9b9-xjgxc to ip-10-0-133-208.ec2.internal

openshift-ingress

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj to ip-10-0-133-208.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x to ip-10-0-130-202.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc to ip-10-0-137-53.ec2.internal
(x8)

openshift-ingress

replicaset-controller

router-default-676fd4f68

FailedCreate

Error creating: pods "router-default-676fd4f68-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-676fd4f68 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-676fd4f68

FailedCreate

Error creating: pods "router-default-676fd4f68-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-676fd4f68

SuccessfulCreate

Created pod: router-default-676fd4f68-q9ztc
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-676fd4f68-q9ztc

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-676fd4f68-q9ztc

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-676fd4f68-q9ztc

Started

Started container router

openshift-ingress

kubelet

router-default-676fd4f68-q9ztc

Created

Created container: router

openshift-ingress

kubelet

router-default-676fd4f68-q9ztc

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-676fd4f68-q9ztc

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-66cb58b9b9

FailedCreate

Error creating: pods "kube-auth-proxy-66cb58b9b9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-66cb58b9b9

SuccessfulCreate

Created pod: kube-auth-proxy-66cb58b9b9-2kghf

openshift-ingress

replicaset-controller

kube-auth-proxy-66cb58b9b9

SuccessfulCreate

Created pod: kube-auth-proxy-66cb58b9b9-xjgxc

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-66cb58b9b9 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-66cb58b9b9-xjgxc

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-xjgxc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-2kghf

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-66cb58b9b9-2kghf

AddedInterface

Add eth0 [10.133.0.15/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-sjdj9

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-sjdj9

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-xjgxc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-xjgxc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-xjgxc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.755s (2.755s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sjdj9

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-2kghf

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-2kghf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.943s (2.943s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-66cb58b9b9-2kghf

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sjdj9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sjdj9

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.416s (2.416s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sjdj9

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.875s (2.875s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cxnh8k

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.404s (4.404s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Started

Started container istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-4xjp4

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-nnn7m

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nnn7m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-nnn7m

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nnn7m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.329s (3.329s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nnn7m

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nnn7m

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-sjdj9

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-sjdj9

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-fnzdk

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-rvwwf

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-7wzmf
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-7wzmf

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-rvwwf

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7wzmf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rvwwf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rvwwf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7wzmf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.295s (2.295s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7wzmf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-7wzmf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rvwwf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-rvwwf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.539s (2.539s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-fnzdk

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-f1d168

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-f1d168-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-f1d168-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-a-f1d168

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-f1d168

openshift-ingress

deployment-controller

e2e-inf-a-f1d168-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-f1d168-openshift-default-5d876c6db from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-f1d168-openshift-default-5d876c6db

SuccessfulCreate

Created pod: e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

openshift-ingress

multus

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-f1d168

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f1d168: serviceaccount "payload-processing-e2e-inf-a-f1d168" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-f1d168

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-f1d168-5646bf4fd9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f1d168-5646bf4fd9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-f1d168-5646bf4fd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-f1d168: serviceaccount "payload-processing-e2e-inf-a-f1d168" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-f1d168-5646bf4fd9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-e9a01385

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-e9a01385

openshift-ingress

deployment-controller

e2e-ait-e9a01385-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-e9a01385-openshift-default-867b4c6f6d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-e9a01385-openshift-default-867b4c6f6d

SuccessfulCreate

Created pod: e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

openshift-ingress

replicaset-controller

e2e-autores-ba18dc-openshift-default-8998bc88

SuccessfulCreate

Created pod: e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

openshift-ingress

deployment-controller

e2e-autores-ba18dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-ba18dc-openshift-default-8998bc88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-ba18dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-ba18dc

openshift-ingress

multus

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e9a01385-587b68f5db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-e9a01385-587b68f5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e9a01385: serviceaccount "payload-processing-e2e-ait-e9a01385" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-e9a01385

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-e9a01385-9cb679b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e9a01385-9cb679b79

SuccessfulCreate

Created pod: payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-e9a01385-9cb679b79

FailedCreate

Error creating: pods "payload-processing-e2e-ait-e9a01385-9cb679b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-e9a01385: serviceaccount "payload-processing-e2e-ait-e9a01385" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-e9a01385-587b68f5db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

openshift-ingress

kubelet

payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-e9a01385

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-e9a01385-587b68f5db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ba18dc-7874cf5cf9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-ba18dc-7874cf5cf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ba18dc: serviceaccount "payload-processing-e2e-autores-ba18dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-ba18dc-7874cf5cf9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-ba18dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-ba18dc: serviceaccount "payload-processing-e2e-autores-ba18dc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-ba18dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-ba18dc-7874cf5cf9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-e6d037-openshift-default-7fc5568d7d

SuccessfulCreate

Created pod: e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e6d037

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e6d037

openshift-ingress

deployment-controller

e2e-inf-b-e6d037-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e6d037-openshift-default-7fc5568d7d from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e6d037: serviceaccount "payload-processing-e2e-inf-b-e6d037" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e6d037

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e6d037: serviceaccount "payload-processing-e2e-inf-b-e6d037" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e6d037

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7 from 0 to 1

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

multus

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-e9a01385-openshift-default-867b4c6f6d-h82tc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-e9a01385-587b68f5db-cx7q5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-e9a01385-9cb679b79-szqcx

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8

SuccessfulCreate

Created pod: e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

openshift-ingress

gateway_labeler_controller

e2e-migrate-b1d82512-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-b1d82512-gw

openshift-ingress

deployment-controller

e2e-migrate-b1d82512-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8 from 0 to 1

openshift-ingress

multus

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b1d82512: serviceaccount "payload-processing-e2e-migrate-b1d82512" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b1d82512-68dd84b8b6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-b1d82512-68dd84b8b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-b1d82512: serviceaccount "payload-processing-e2e-migrate-b1d82512" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-b1d82512

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-b1d82512-665447d6b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-b1d82512

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-b1d82512-68dd84b8b6 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj
(x2)

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-b1d82512-68dd84b8b6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-b1d82512-665447d6b6-49kpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-b1d82512-gw-openshift-default-5cc86db8b8-4rd64

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-b1d82512-68dd84b8b6-dhbhf

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-0d6a65c4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0d6a65c4

openshift-ingress

deployment-controller

e2e-ait-0d6a65c4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b

SuccessfulCreate

Created pod: e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

openshift-ingress

multus

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0d6a65c4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0d6a65c4-55b7b5bd5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0d6a65c4: serviceaccount "payload-processing-e2e-ait-0d6a65c4" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0d6a65c4: serviceaccount "payload-processing-e2e-ait-0d6a65c4" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0d6a65c4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-0d6a65c4-55b7b5bd5-8gspz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0d6a65c4-64499bf5cd-xmvjt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-e404ac71

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e404ac71

openshift-ingress

deployment-controller

e2e-derive-e404ac71-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e404ac71-openshift-default-54768bd444 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-e404ac71-openshift-default-54768bd444

SuccessfulCreate

Created pod: e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

openshift-ingress

multus

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-0d6a65c4-openshift-default-6fd74fcc4b-29jg8

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e404ac71-74d6d9cb5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e404ac71-74d6d9cb5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e404ac71-74d6d9cb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e404ac71: serviceaccount "payload-processing-e2e-derive-e404ac71" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e404ac71-78ccb64454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e404ac71-78ccb64454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e404ac71: serviceaccount "payload-processing-e2e-derive-e404ac71" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e404ac71-78ccb64454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e404ac71

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e404ac71-78ccb64454 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e404ac71

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e404ac71-74d6d9cb5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-ba18dc-fc9fbc8f8-7s7tt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-ba18dc-7874cf5cf9-pwmfw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e404ac71-74d6d9cb5-jqxs6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e404ac71-78ccb64454-7vxww

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-e404ac71-openshift-default-54768bd444-xgfq2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-7eb0a3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4

SuccessfulCreate

Created pod: e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

openshift-ingress

gateway_labeler_controller

e2e-explicit-7eb0a3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7eb0a3

openshift-ingress

multus

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-ba18dc-openshift-default-8998bc88-wrxcj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7eb0a3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7eb0a3: serviceaccount "payload-processing-e2e-explicit-7eb0a3" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7eb0a3-579745d465

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7eb0a3-579745d465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7eb0a3: serviceaccount "payload-processing-e2e-explicit-7eb0a3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7eb0a3-579745d465

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7eb0a3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7eb0a3-579745d465 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-21316764

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-21316764

openshift-ingress

replicaset-controller

e2e-mt-21316764-openshift-default-fb968c688

SuccessfulCreate

Created pod: e2e-mt-21316764-openshift-default-fb968c688-gfrtn

openshift-ingress

deployment-controller

e2e-mt-21316764-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-21316764-openshift-default-fb968c688 from 0 to 1

openshift-ingress

multus

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-21316764

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-21316764-b89df7f66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-21316764

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-21316764-6c95fdc4fc from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-21316764-b89df7f66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-21316764-b89df7f66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-21316764: serviceaccount "payload-processing-e2e-mt-21316764" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-21316764-6c95fdc4fc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-21316764-6c95fdc4fc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-21316764-6c95fdc4fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-21316764: serviceaccount "payload-processing-e2e-mt-21316764" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-21316764-b89df7f66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7eb0a3-579745d465-ljpdw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7eb0a3-5cbd44d4b-2w6nh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-7eb0a3-openshift-default-5bdf4fdbd4-fwtbm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-33cc41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-33cc41-openshift-default-5897cb6cfd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-33cc41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-33cc41

openshift-ingress

multus

e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-noten-33cc41-openshift-default-5897cb6cfd

SuccessfulCreate

Created pod: e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

openshift-ingress

kubelet

e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-21316764-b89df7f66-p76nb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-21316764-6c95fdc4fc-6sj2n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-33cc41-openshift-default-5897cb6cfd-w2jb8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-21316764-openshift-default-fb968c688-gfrtn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-a-f1d168-5646bf4fd9-cncfg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-f1d168

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-f1d168: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-f1d168": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-f1d168, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e3a1fc65-3d69-4ada-bf06-6ac17aab722d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-f1d168-59ccb6f95d-wcfl9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-f1d168-openshift-default-5d876c6db-x4xv2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w2-3d0caa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-3d0caa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-3d0caa

openshift-ingress

replicaset-controller

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666

SuccessfulCreate

Created pod: e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

openshift-ingress

multus

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-3d0caa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3d0caa: serviceaccount "payload-processing-e2e-shared-a-w2-3d0caa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-3d0caa: serviceaccount "payload-processing-e2e-shared-a-w2-3d0caa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-3d0caa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e6d037-7c4b8f8fc7-v4d2k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e6d037-57cfd6cff8-q6bb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-579ae1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-579ae1

openshift-ingress

deployment-controller

e2e-shared-a-w3-579ae1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-579ae1-openshift-default-5c98577844 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-579ae1-openshift-default-5c98577844

SuccessfulCreate

Created pod: e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-e6d037-openshift-default-7fc5568d7d-46l5p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-579ae1: serviceaccount "payload-processing-e2e-shared-a-w3-579ae1" not found

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b3723e-openshift-default-79b5456544

SuccessfulCreate

Created pod: e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-b3723e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b3723e-openshift-default-79b5456544 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-579ae1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-579ae1-9979545f5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-579ae1-9979545f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-579ae1: serviceaccount "payload-processing-e2e-shared-a-w3-579ae1" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-579ae1-9979545f5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-579ae1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-579ae1-9979545f5 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b3723e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b3723e

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b3723e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b3723e: serviceaccount "payload-processing-e2e-shared-b-w2-b3723e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b3723e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

Created

Created container: payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b3723e: serviceaccount "payload-processing-e2e-shared-b-w2-b3723e" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-d5c012

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-d5c012

openshift-ingress

replicaset-controller

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd

SuccessfulCreate

Created pod: e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

openshift-ingress

deployment-controller

e2e-shared-b-w3-d5c012-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-d5c012

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-d5c012

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-d5c012-569d4d996c from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d5c012: serviceaccount "payload-processing-e2e-shared-b-w3-d5c012" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6
(x6)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-d5c012: serviceaccount "payload-processing-e2e-shared-b-w3-d5c012" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.124s (2.124s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-a6883ccf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a6883ccf

openshift-ingress

deployment-controller

e2e-mt-a6883ccf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a6883ccf-openshift-default-79d7dd8984 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-a6883ccf-openshift-default-79d7dd8984

SuccessfulCreate

Created pod: e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

openshift-ingress

multus

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a6883ccf-847569cc57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a6883ccf: serviceaccount "payload-processing-e2e-mt-a6883ccf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a6883ccf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a6883ccf-847569cc57 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a6883ccf-847569cc57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a6883ccf-847569cc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a6883ccf: serviceaccount "payload-processing-e2e-mt-a6883ccf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a6883ccf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Unhealthy

Startup probe failed: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

ProbeError

Startup probe error: Get "http://10.134.0.58:15021/healthz/ready": dial tcp 10.134.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a6883ccf-779cb5cb94-ltxxb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a6883ccf-847569cc57-hcpnn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-a6883ccf-openshift-default-79d7dd8984-xk9l8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-api-a-d5fa55-openshift-default-54dd6456fb

SuccessfulCreate

Created pod: e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

openshift-ingress

gateway_labeler_controller

e2e-api-a-d5fa55

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-d5fa55

openshift-ingress

deployment-controller

e2e-api-a-d5fa55-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-d5fa55-openshift-default-54dd6456fb from 0 to 1

openshift-ingress

multus

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d5fa55: serviceaccount "payload-processing-e2e-api-a-d5fa55" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-d5fa55

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-d5fa55-94d5976bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-d5fa55: serviceaccount "payload-processing-e2e-api-a-d5fa55" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-d5fa55

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-d5fa55-5c75fbf9d7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-fc1974-openshift-default-59b6546c94

SuccessfulCreate

Created pod: e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

openshift-ingress

gateway_labeler_controller

e2e-api-b-fc1974

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-fc1974

openshift-ingress

deployment-controller

e2e-api-b-fc1974-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-fc1974-openshift-default-59b6546c94 from 0 to 1

openshift-ingress

multus

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-fc1974

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-fc1974-5d57bb757 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fc1974: serviceaccount "payload-processing-e2e-api-b-fc1974" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-fc1974-5d57bb757

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-fc1974-5d57bb757-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-fc1974: serviceaccount "payload-processing-e2e-api-b-fc1974" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-fc1974-5d57bb757

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-fc1974

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-d5fa55-5c75fbf9d7-bcw5x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-d5fa55-94d5976bb-dvx9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-d5fa55-openshift-default-54dd6456fb-gq4ds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-fc1974-75d8bdb7fd-ptg6c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-fc1974-5d57bb757-x9n75

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-fc1974-openshift-default-59b6546c94-kdq8q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-3d0caa-58bdf89585-w2r86

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-3d0caa-f76b667c4-58fs4

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-3d0caa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3d0caa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-3d0caa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3d0caa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08b65e50-af8a-43f6-890f-fcefd73ccd36, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-3d0caa-openshift-default-7f848b5666-f5vgj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b3723e-5cbcdccc7d-24r2j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b3723e-5b97db79f9-fkg6x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b3723e-openshift-default-79b5456544-5km6g

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-0fe383-openshift-default-5789b5d97b

SuccessfulCreate

Created pod: e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

openshift-ingress

deployment-controller

e2e-ipp-a-0fe383-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-0fe383-openshift-default-5789b5d97b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-0fe383

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-0fe383

openshift-ingress

multus

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-0fe383

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-0fe383-6f48564747 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-0fe383

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0fe383-6f48564747

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-0fe383-6f48564747

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-0fe383-6f48564747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0fe383: serviceaccount "payload-processing-e2e-ipp-a-0fe383" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-0fe383: serviceaccount "payload-processing-e2e-ipp-a-0fe383" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-fc6ea5

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-fc6ea5-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-fc6ea5-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-fc6ea5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-fc6ea5

openshift-ingress

deployment-controller

e2e-ipp-b-fc6ea5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-fc6ea5-openshift-default-57874f989b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-fc6ea5-openshift-default-57874f989b

SuccessfulCreate

Created pod: e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

openshift-ingress

multus

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fc6ea5: serviceaccount "payload-processing-e2e-ipp-b-fc6ea5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fc6ea5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fc6ea5-946fdd767

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fc6ea5-946fdd767

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fc6ea5-946fdd767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fc6ea5: serviceaccount "payload-processing-e2e-ipp-b-fc6ea5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fc6ea5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fc6ea5-946fdd767 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-ae1e0d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-ae1e0d

openshift-ingress

deployment-controller

e2e-ipp-cleanup-ae1e0d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6

SuccessfulCreate

Created pod: e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

openshift-ingress

multus

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ae1e0d: serviceaccount "payload-processing-e2e-ipp-cleanup-ae1e0d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-ae1e0d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-ae1e0d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-ae1e0d: serviceaccount "payload-processing-e2e-ipp-cleanup-ae1e0d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

ProbeError

Startup probe error: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

Unhealthy

Startup probe failed: Get "http://10.132.0.94:15021/healthz/ready": dial tcp 10.132.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-ae1e0d-c65b467c9-6wtqc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-ae1e0d-b8ffbfbfd-brgwh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-ae1e0d-openshift-default-f647fb6f6-7t5pj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-0fe383-6f48564747-jgtv5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-0fe383-78c6c8b946-lj4c2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-0fe383-openshift-default-5789b5d97b-dv9cr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fc6ea5-946fdd767-jm9jt

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-fc6ea5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-fc6ea5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-fc6ea5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-fc6ea5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2eb3c255-ac1c-48dc-a629-63e549ca212b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fc6ea5-86cb75996b-cxmvr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-fc6ea5-openshift-default-57874f989b-66sgf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-579ae1-686ff76ff4-s6v96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-579ae1-9979545f5-pzb56

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-579ae1-openshift-default-5c98577844-rqk8j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-d5c012-86649856bb-4fvb6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-d5c012-569d4d996c-qp259

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-d5c012-openshift-default-7b8c88d4dd-cdbx7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503