Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-api-a-25d966-58586b8b7-4z22r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-25d966-58586b8b7-4z22r to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27 to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp to ip-10-0-128-61.ec2.internal

openshift-ingress

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9 to ip-10-0-128-61.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-rmlv4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-rmlv4 to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Scheduled

Successfully assigned openshift-ingress/e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t to ip-10-0-128-61.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-vt6h5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-vt6h5 to ip-10-0-128-61.ec2.internal

openshift-ingress

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Scheduled

Successfully assigned openshift-ingress/e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j to ip-10-0-128-61.ec2.internal

openshift-ingress

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a43b7e35-openshift-default-5997467596-4nksj to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78 to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9 to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-9c2ks

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-9c2ks to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94 to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg to ip-10-0-128-61.ec2.internal

openshift-ingress

kube-auth-proxy-85db8bc976-rqrh9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-85db8bc976-rqrh9 to ip-10-0-128-61.ec2.internal

openshift-ingress

router-default-7f6c8885b8-v8qbh

Scheduled

Successfully assigned openshift-ingress/router-default-7f6c8885b8-v8qbh to ip-10-0-128-61.ec2.internal

openshift-ingress

router-default-7f6c8885b8-v8qbh

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4 to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9 to ip-10-0-133-119.ec2.internal

openshift-ingress

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs to ip-10-0-128-61.ec2.internal

openshift-ingress

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8 to ip-10-0-128-61.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-8tbt9 to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59 to ip-10-0-134-141.ec2.internal

openshift-ingress

kube-auth-proxy-85db8bc976-sc7bd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-85db8bc976-sc7bd to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr to ip-10-0-133-119.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-s8xqq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-s8xqq to ip-10-0-133-119.ec2.internal

openshift-ingress

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp to ip-10-0-134-141.ec2.internal

openshift-ingress

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4 to ip-10-0-128-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf to ip-10-0-128-61.ec2.internal

openshift-ingress

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62 to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2 to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-processing-e2e-derive-5d398f01-787478fd89-plszf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-5d398f01-787478fd89-plszf to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx to ip-10-0-133-119.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p to ip-10-0-133-119.ec2.internal

openshift-ingress

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Scheduled

Successfully assigned openshift-ingress/e2e-derive-5d398f01-openshift-default-899bff88-6pvt5 to ip-10-0-128-61.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr to ip-10-0-134-141.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln to ip-10-0-128-61.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7f6c8885b8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x11)

openshift-ingress

replicaset-controller

router-default-7f6c8885b8

FailedCreate

Error creating: pods "router-default-7f6c8885b8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-7f6c8885b8

FailedCreate

Error creating: pods "router-default-7f6c8885b8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-7f6c8885b8

SuccessfulCreate

Created pod: router-default-7f6c8885b8-v8qbh
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-7f6c8885b8-v8qbh

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7f6c8885b8-v8qbh

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-7f6c8885b8-v8qbh

Created

Created container: router

openshift-ingress

kubelet

router-default-7f6c8885b8-v8qbh

Started

Started container router

openshift-ingress

kubelet

router-default-7f6c8885b8-v8qbh

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-7f6c8885b8-v8qbh

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-85db8bc976

SuccessfulCreate

Created pod: kube-auth-proxy-85db8bc976-sc7bd

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-85db8bc976 from 0 to 2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-85db8bc976

FailedCreate

Error creating: pods "kube-auth-proxy-85db8bc976-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-85db8bc976

SuccessfulCreate

Created pod: kube-auth-proxy-85db8bc976-rqrh9

openshift-ingress

multus

kube-auth-proxy-85db8bc976-sc7bd

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-rqrh9

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-sc7bd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-85db8bc976-rqrh9

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-rqrh9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-vt6h5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-vt6h5

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-sc7bd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.981s (2.981s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-sc7bd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-sc7bd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-rqrh9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 6.38s (6.38s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-rqrh9

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-85db8bc976-rqrh9

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.723s (5.723s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rmlv4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-rmlv4

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-rmlv4

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rmlv4

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-vwklr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.157s (4.157s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rmlv4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.077s (4.077s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-rmlv4

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-vt6h5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-vt6h5

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-8tbt9

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-9c2ks

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-s8xqq
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-processing-5b54b7fbb7-9c2ks

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s8xqq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-s8xqq

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9c2ks

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s8xqq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s8xqq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-s8xqq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.317s (2.317s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9c2ks

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.904s (2.904s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9c2ks

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-9c2ks

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-8tbt9

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6

SuccessfulCreate

Created pod: e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

openshift-ingress

deployment-controller

e2e-inf-a-a5e1c2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6 from 0 to 1

openshift-ingress

multus

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a5e1c2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a5e1c2

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.656s (2.656s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a5e1c2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a5e1c2-668959c467 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a5e1c2-668959c467

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a5e1c2-668959c467

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a5e1c2-668959c467-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a5e1c2: serviceaccount "payload-processing-e2e-inf-a-a5e1c2" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a5e1c2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a5e1c2: serviceaccount "payload-processing-e2e-inf-a-a5e1c2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

openshift-ingress

multus

payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-f81019dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f81019dc

openshift-ingress

deployment-controller

e2e-ait-f81019dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f81019dc-openshift-default-6697f58cb4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f81019dc-openshift-default-6697f58cb4

SuccessfulCreate

Created pod: e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

openshift-ingress

multus

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f81019dc: serviceaccount "payload-processing-e2e-ait-f81019dc" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f81019dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f81019dc-5bbf4b4cc5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f81019dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f81019dc-68cfbbb94 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f81019dc: serviceaccount "payload-processing-e2e-ait-f81019dc" not found

openshift-ingress

multus

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Unhealthy

Readiness probe failed: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

ProbeError

Readiness probe error: Get "http://10.132.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-inf-b-d4ad2d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d4ad2d-openshift-default-bfdc49f66 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d4ad2d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d4ad2d
(x2)

openshift-ingress

kubelet

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66

SuccessfulCreate

Created pod: e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz
(x5)

openshift-ingress

kubelet

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d4ad2d-66db96c549

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d4ad2d-66db96c549-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d4ad2d: serviceaccount "payload-processing-e2e-inf-b-d4ad2d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d4ad2d-66db96c549

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d4ad2d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d4ad2d-66db96c549 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d4ad2d: serviceaccount "payload-processing-e2e-inf-b-d4ad2d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d4ad2d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.417s (2.417s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

ProbeError

Readiness probe error: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Unhealthy

Readiness probe failed: Get "http://10.132.0.53:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f81019dc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f81019dc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f81019dc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f81019dc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8346ba76-5fdd-4321-a050-77b81a358b34, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-f81019dc-5bbf4b4cc5-8dfln

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f81019dc-68cfbbb94-cljdf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-f81019dc-openshift-default-6697f58cb4-wg6pg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-migrate-6fda89ac-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-6fda89ac-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6fda89ac-gw

openshift-ingress

replicaset-controller

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4

SuccessfulCreate

Created pod: e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

openshift-ingress

multus

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-6fda89ac-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-6fda89ac-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-6fda89ac-gw-authn-ssl" already exists
(x5)

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused

openshift-ingress

multus

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6fda89ac: serviceaccount "payload-processing-e2e-migrate-6fda89ac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

openshift-ingress

kubelet

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6fda89ac: serviceaccount "payload-processing-e2e-migrate-6fda89ac" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6fda89ac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6fda89ac-6ccbc895f8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6fda89ac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:55772->10.132.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": read tcp 10.132.0.2:55772->10.132.0.54:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-6fda89ac-6ccbc895f8-kkq59

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6fda89ac-6899cf7fd6-h6tfv

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-a43b7e35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a43b7e35

openshift-ingress

multus

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-a43b7e35-openshift-default-5997467596

SuccessfulCreate

Created pod: e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

openshift-ingress

deployment-controller

e2e-ait-a43b7e35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a43b7e35-openshift-default-5997467596 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a43b7e35-6d9dc7799

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a43b7e35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a43b7e35: serviceaccount "payload-processing-e2e-ait-a43b7e35" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

openshift-ingress

multus

payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a43b7e35-6d9dc7799

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a43b7e35-6d9dc7799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a43b7e35: serviceaccount "payload-processing-e2e-ait-a43b7e35" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a43b7e35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a43b7e35-6d9dc7799 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-6fda89ac-gw-openshift-default-68db6945d4-vwjfs

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Unhealthy

Readiness probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

ProbeError

Readiness probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a43b7e35-76d84c6c8b-pshjp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a43b7e35-6d9dc7799-vhscg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-5d398f01

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-5d398f01

openshift-ingress

deployment-controller

e2e-derive-5d398f01-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-5d398f01-openshift-default-899bff88 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-5d398f01-openshift-default-899bff88

SuccessfulCreate

Created pod: e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

openshift-ingress

multus

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-a43b7e35-openshift-default-5997467596-4nksj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-derive-5d398f01

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-5d398f01-787478fd89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-5d398f01

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-5d398f01-7475ddf6db from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5d398f01-787478fd89

FailedCreate

Error creating: pods "payload-processing-e2e-derive-5d398f01-787478fd89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5d398f01: serviceaccount "payload-processing-e2e-derive-5d398f01" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-5d398f01-787478fd89

SuccessfulCreate

Created pod: payload-processing-e2e-derive-5d398f01-787478fd89-plszf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-5d398f01: serviceaccount "payload-processing-e2e-derive-5d398f01" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-5d398f01-787478fd89-plszf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-5d398f01-787478fd89-plszf

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5d398f01-787478fd89-plszf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-5d398f01-787478fd89-plszf

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

ProbeError

Startup probe error: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Unhealthy

Startup probe failed: Get "http://10.132.0.58:15021/healthz/ready": dial tcp 10.132.0.58:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-5d398f01-787478fd89-plszf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-5d398f01-7475ddf6db-mpghd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-5d398f01-openshift-default-899bff88-6pvt5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a5e1c2-668959c467-twtq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a5e1c2-7d84c588d6-nxr5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-a5e1c2-openshift-default-65dfdf4ff6-9njtb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d4ad2d-6b4d78699d-cqf94

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d4ad2d-66db96c549-42sfr

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-6680c7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-6680c7

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-6680c7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-d4ad2d-openshift-default-bfdc49f66-7k4lz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6

SuccessfulCreate

Created pod: e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-6680c7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6680c7: serviceaccount "payload-processing-e2e-shared-a-w3-6680c7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-6680c7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-6680c7: serviceaccount "payload-processing-e2e-shared-a-w3-6680c7" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-mt-806943a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-806943a9-openshift-default-74b4bcb676 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-806943a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-806943a9

openshift-ingress

replicaset-controller

e2e-mt-806943a9-openshift-default-74b4bcb676

SuccessfulCreate

Created pod: e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

openshift-ingress

multus

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-mt-806943a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-806943a9-6c744fcd97 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-806943a9-6c744fcd97

SuccessfulCreate

Created pod: payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-806943a9-6c744fcd97

FailedCreate

Error creating: pods "payload-processing-e2e-mt-806943a9-6c744fcd97-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-806943a9: serviceaccount "payload-processing-e2e-mt-806943a9" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-806943a9: serviceaccount "payload-processing-e2e-mt-806943a9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-806943a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-806943a9-65ddb6cb66 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-7a26c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-7a26c9

openshift-ingress

replicaset-controller

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4

SuccessfulCreate

Created pod: e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

openshift-ingress

deployment-controller

e2e-shared-b-w3-7a26c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-7a26c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7a26c9: serviceaccount "payload-processing-e2e-shared-b-w3-7a26c9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-7a26c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-7a26c9-bbff86557 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-7a26c9: serviceaccount "payload-processing-e2e-shared-b-w3-7a26c9" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:40418->10.132.0.63:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": read tcp 10.132.0.2:40418->10.132.0.63:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-806943a9-65ddb6cb66-2ckbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-806943a9-6c744fcd97-9wb9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-806943a9-openshift-default-74b4bcb676-gfl4j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-a-w2-fc3156-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8

SuccessfulCreate

Created pod: e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-fc3156

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-fc3156

openshift-ingress

multus

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-fc3156

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-fc3156

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fc3156: serviceaccount "payload-processing-e2e-shared-a-w2-fc3156" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-fc3156: serviceaccount "payload-processing-e2e-shared-a-w2-fc3156" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Unhealthy

Readiness probe failed: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

ProbeError

Readiness probe error: Get "http://10.132.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-3abe72

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-3abe72

openshift-ingress

replicaset-controller

e2e-shared-b-w2-3abe72-openshift-default-674b6895b

SuccessfulCreate

Created pod: e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

openshift-ingress

deployment-controller

e2e-shared-b-w2-3abe72-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-3abe72-openshift-default-674b6895b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3abe72-759f75d775

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-3abe72-759f75d775-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3abe72: serviceaccount "payload-processing-e2e-shared-b-w2-3abe72" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-3abe72-759f75d775

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-3abe72

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-3abe72-759f75d775 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-3abe72

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-3abe72: serviceaccount "payload-processing-e2e-shared-b-w2-3abe72" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-bba28942

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-bba28942

openshift-ingress

multus

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-bba28942-openshift-default-5496dc456d

SuccessfulCreate

Created pod: e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

openshift-ingress

deployment-controller

e2e-mt-bba28942-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-bba28942-openshift-default-5496dc456d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-bba28942

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-bba28942-76c6dcb87c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bba28942-76c6dcb87c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-bba28942-76c6dcb87c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bba28942: serviceaccount "payload-processing-e2e-mt-bba28942" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-bba28942

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-bba28942-7bc6b77994 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-bba28942-76c6dcb87c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bba28942-7bc6b77994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-bba28942-7bc6b77994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-bba28942-7bc6b77994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-bba28942: serviceaccount "payload-processing-e2e-mt-bba28942" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-bba28942-7bc6b77994-gzlc9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-bba28942-76c6dcb87c-slbqx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-bba28942-openshift-default-5496dc456d-jqx7t

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-api-a-25d966-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-25d966-openshift-default-69cf6db6b4 from 0 to 1

openshift-ingress

multus

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-a-25d966

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-25d966

openshift-ingress

replicaset-controller

e2e-api-a-25d966-openshift-default-69cf6db6b4

SuccessfulCreate

Created pod: e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-25d966

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-25d966-58586b8b7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-25d966

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-25d966-78656d59d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-25d966-78656d59d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-25d966-78656d59d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-25d966: serviceaccount "payload-processing-e2e-api-a-25d966" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-25d966-78656d59d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-25d966-58586b8b7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-25d966-58586b8b7-4z22r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-25d966-58586b8b7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-25d966-58586b8b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-25d966: serviceaccount "payload-processing-e2e-api-a-25d966" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d966-58586b8b7-4z22r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d966-58586b8b7-4z22r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d966-58586b8b7-4z22r

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-25d966-58586b8b7-4z22r

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-dac33e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-dac33e

openshift-ingress

replicaset-controller

e2e-api-b-dac33e-openshift-default-66f5c86d88

SuccessfulCreate

Created pod: e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

openshift-ingress

deployment-controller

e2e-api-b-dac33e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-dac33e-openshift-default-66f5c86d88 from 0 to 1

openshift-ingress

multus

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dac33e-8685769f94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-dac33e-8685769f94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dac33e: serviceaccount "payload-processing-e2e-api-b-dac33e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-dac33e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-dac33e-5b9f789887 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dac33e-5b9f789887

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-dac33e-5b9f789887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-dac33e: serviceaccount "payload-processing-e2e-api-b-dac33e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-dac33e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-dac33e-8685769f94 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-dac33e-5b9f789887

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-dac33e-8685769f94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

openshift-ingress

kubelet

payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-cc92e2-openshift-default-584848fff8

SuccessfulCreate

Created pod: e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

openshift-ingress

deployment-controller

e2e-ipp-a-cc92e2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-cc92e2-openshift-default-584848fff8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-cc92e2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-cc92e2

openshift-ingress

multus

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q
(x2)

openshift-ingress

kubelet

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-cc92e2: serviceaccount "payload-processing-e2e-ipp-a-cc92e2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-cc92e2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-cc92e2-7f8969f67c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-cc92e2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-cc92e2: serviceaccount "payload-processing-e2e-ipp-a-cc92e2" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d966-78656d59d-6xt62

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-f2fbdf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-f2fbdf

openshift-ingress

multus

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d966-58586b8b7-4z22r

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6

SuccessfulCreate

Created pod: e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr
(x5)

openshift-ingress

kubelet

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-f2fbdf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f2fbdf-996bc5647

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-f2fbdf-996bc5647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f2fbdf: serviceaccount "payload-processing-e2e-ipp-b-f2fbdf" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-f2fbdf-996bc5647

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-f2fbdf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-f2fbdf-996bc5647 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-f2fbdf: serviceaccount "payload-processing-e2e-ipp-b-f2fbdf" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-f2fbdf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-25d966-openshift-default-69cf6db6b4-fg6hc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-dac33e-5b9f789887-bk65c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-dac33e-8685769f94-nmp27

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

ProbeError

Startup probe error: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Unhealthy

Startup probe failed: Get "http://10.134.0.63:15021/healthz/ready": dial tcp 10.134.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-dac33e-openshift-default-66f5c86d88-6b7r4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-fc3156-66c6b5dfcd-sb29r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-fc3156-5bc876dc85-lrvqq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-fc3156-openshift-default-5f4d866fc8-2sdx8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-3abe72-759f75d775-thmcl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-3abe72-7d66d7b74-cfh78

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b7805e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b7805e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b7805e

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

openshift-ingress

multus

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-3abe72-openshift-default-674b6895b-rm7mp

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b7805e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b7805e: serviceaccount "payload-processing-e2e-ipp-cleanup-b7805e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b7805e: serviceaccount "payload-processing-e2e-ipp-cleanup-b7805e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b7805e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b7805e-7fff88ccd9-8f6nw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b7805e-5c46945674-9dvzq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-ipp-cleanup-b7805e-openshift-default-79dc65c66b-pvn5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-cc92e2-7f8969f67c-npblg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-cc92e2-5b86bb5f58-88w7q

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-cc92e2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-cc92e2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-cc92e2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-cc92e2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e1793c36-5379-4211-9e89-f888d3b15e77, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-cc92e2-openshift-default-584848fff8-xgg4j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-f2fbdf-996bc5647-qbkhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-f2fbdf-68fdf785f8-7jjzv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-f2fbdf-openshift-default-5fb7c78cf6-xzbqr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-6680c7-7c549bbfb6-9sltd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-6680c7-79994f6b8c-d98g9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-6680c7-openshift-default-7fb8cffbc6-cj5qr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-7a26c9-bbff86557-s68g4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-7a26c9-7788887478-vgzxx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-7a26c9-openshift-default-55ccf765f4-hslf9

Killing

Stopping container istio-proxy