Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8 to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6 to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

Scheduled

Successfully assigned openshift-ingress/e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2 to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2 to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8 to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

Scheduled

Successfully assigned openshift-ingress/e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw to ip-10-0-140-70.ec2.internal

openshift-ingress

kube-auth-proxy-5d5f7bb976-c5lcl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d5f7bb976-c5lcl to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f547da13-746c6b576f-97wxd to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx to ip-10-0-140-70.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-gwjck

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-gwjck to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9 to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k to ip-10-0-131-122.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-9cg2m

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-9cg2m to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-l5kqq

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-l5kqq to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a7eaac-openshift-default-549f686644-9472b to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc to ip-10-0-131-122.ec2.internal

openshift-ingress

router-default-79d99445d4-9hhp8

Scheduled

Successfully assigned openshift-ingress/router-default-79d99445d4-9hhp8 to ip-10-0-140-70.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86 to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6 to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6 to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9 to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2 to ip-10-0-131-122.ec2.internal

openshift-ingress

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Scheduled

Successfully assigned openshift-ingress/e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Scheduled

Successfully assigned openshift-ingress/e2e-autores-944e93-openshift-default-777cdf84fd-52k6f to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7 to ip-10-0-131-122.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-2z4lv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-2z4lv to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2 to ip-10-0-131-122.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-nmjcb to ip-10-0-131-122.ec2.internal

openshift-ingress

kube-auth-proxy-5d5f7bb976-7h66z

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5d5f7bb976-7h66z to ip-10-0-142-242.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1b0d05f3-6646647789-627hj to ip-10-0-140-70.ec2.internal

openshift-ingress

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-00a938-openshift-default-678576d748-nz8ht to ip-10-0-140-70.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh to ip-10-0-140-70.ec2.internal

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-79d99445d4 from 0 to 1
(x17)

openshift-ingress

replicaset-controller

router-default-79d99445d4

FailedCreate

Error creating: pods "router-default-79d99445d4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-79d99445d4

SuccessfulCreate

Created pod: router-default-79d99445d4-9hhp8

openshift-ingress

multus

router-default-79d99445d4-9hhp8

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-79d99445d4-9hhp8

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-79d99445d4-9hhp8

Created

Created container: router

openshift-ingress

kubelet

router-default-79d99445d4-9hhp8

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-5d5f7bb976

SuccessfulCreate

Created pod: kube-auth-proxy-5d5f7bb976-c5lcl

openshift-ingress

replicaset-controller

kube-auth-proxy-5d5f7bb976

SuccessfulCreate

Created pod: kube-auth-proxy-5d5f7bb976-7h66z
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-5d5f7bb976

FailedCreate

Error creating: pods "kube-auth-proxy-5d5f7bb976-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5d5f7bb976 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-c5lcl

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-7h66z

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-7h66z

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-9cg2m

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5d5f7bb976-7h66z

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-c5lcl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5d5f7bb976-c5lcl

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-9cg2m

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-7h66z

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-7h66z

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-7h66z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.594s (2.594s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-c5lcl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.467s (2.467s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-c5lcl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5d5f7bb976-c5lcl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.57s (3.57s including waiting). Image size: 181126104 bytes.

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cwvdqx

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.745s (2.745s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-gwjck

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-gwjck

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gwjck

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gwjck

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.908s (2.908s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gwjck

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-gwjck

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-9cg2m

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-9cg2m
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-nmjcb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.323s (4.323s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-2z4lv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-l5kqq

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-2z4lv

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-l5kqq

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-l5kqq

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2z4lv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2z4lv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.677s (1.677s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2z4lv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2z4lv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-l5kqq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.306s (3.306s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-l5kqq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-l5kqq

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-nmjcb

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-00a938

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-00a938

openshift-ingress

replicaset-controller

e2e-inf-a-00a938-openshift-default-678576d748

SuccessfulCreate

Created pod: e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

openshift-ingress

deployment-controller

e2e-inf-a-00a938-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-00a938-openshift-default-678576d748 from 0 to 1

openshift-ingress

multus

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-00a938

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-00a938-6b958b6b47 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-00a938: serviceaccount "payload-processing-e2e-inf-a-00a938" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

openshift-ingress

kubelet

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-00a938-6b958b6b47

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-00a938-6b958b6b47

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-00a938-6b958b6b47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-00a938: serviceaccount "payload-processing-e2e-inf-a-00a938" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-00a938

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-944e93

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-944e93

openshift-ingress

multus

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-944e93-openshift-default-777cdf84fd

SuccessfulCreate

Created pod: e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

openshift-ingress

multus

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-f547da13-openshift-default-7cf9fd78f4

SuccessfulCreate

Created pod: e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

openshift-ingress

deployment-controller

e2e-ait-f547da13-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f547da13-openshift-default-7cf9fd78f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-f547da13

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f547da13

openshift-ingress

deployment-controller

e2e-autores-944e93-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-944e93-openshift-default-777cdf84fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f547da13

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f547da13-746c6b576f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f547da13

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f547da13: serviceaccount "payload-processing-e2e-ait-f547da13" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f547da13-746c6b576f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f547da13-746c6b576f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f547da13: serviceaccount "payload-processing-e2e-ait-f547da13" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

openshift-ingress

kubelet

payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f547da13-746c6b576f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

openshift-ingress

kubelet

payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-944e93-55f85bfb4f

FailedCreate

Error creating: pods "payload-processing-e2e-autores-944e93-55f85bfb4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-944e93: serviceaccount "payload-processing-e2e-autores-944e93" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-944e93-6785b44586

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-944e93-6785b44586-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-944e93: serviceaccount "payload-processing-e2e-autores-944e93" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-autores-944e93

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-944e93-55f85bfb4f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-944e93-55f85bfb4f

SuccessfulCreate

Created pod: payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

openshift-ingress

kubelet

payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-944e93-6785b44586

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-944e93

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-944e93-6785b44586 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

ProbeError

Readiness probe error: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Unhealthy

Readiness probe failed: Get "http://10.132.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Started

Started container istio-proxy

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-5d685d

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-5d685d-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-5d685d-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5d685d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5d685d

openshift-ingress

deployment-controller

e2e-inf-b-5d685d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5d685d-openshift-default-bcd55c84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-5d685d-openshift-default-bcd55c84

SuccessfulCreate

Created pod: e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

openshift-ingress

multus

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5d685d-8464b8954c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5d685d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5d685d-8464b8954c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5d685d: serviceaccount "payload-processing-e2e-inf-b-5d685d" not found
(x2)

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5d685d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5d685d-568dbccf98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5d685d-8464b8954c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5d685d-8464b8954c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5d685d: serviceaccount "payload-processing-e2e-inf-b-5d685d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Started

Started container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f547da13

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f547da13: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f547da13": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f547da13, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6905c03f-245a-4e67-9485-6b04a0f5664d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-f547da13-746c6b576f-97wxd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-f547da13-openshift-default-7cf9fd78f4-z97kx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f547da13-6d8b9fdd6-km2bb

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb

SuccessfulCreate

Created pod: e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

openshift-ingress

deployment-controller

e2e-migrate-d3676176-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-d3676176-gw-openshift-default-766ccf88fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-d3676176-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-d3676176-gw

openshift-ingress

multus

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d3676176-7c8dbd956b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-d3676176-7c8dbd956b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d3676176: serviceaccount "payload-processing-e2e-migrate-d3676176" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-d3676176-7c8dbd956b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-d3676176

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-d3676176-9479c64bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d3676176-9479c64bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-d3676176-9479c64bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-d3676176-9479c64bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-d3676176: serviceaccount "payload-processing-e2e-migrate-d3676176" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-d3676176

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-d3676176-7c8dbd956b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-d3676176-9479c64bb-v77qh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-d3676176-7c8dbd956b-r4rm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-1b0d05f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1b0d05f3-openshift-default-678c988cf8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1b0d05f3-openshift-default-678c988cf8

SuccessfulCreate

Created pod: e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

openshift-ingress

gateway_labeler_controller

e2e-ait-1b0d05f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1b0d05f3

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1b0d05f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1b0d05f3-6646647789 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-d3676176-gw-openshift-default-766ccf88fb-bwrzl

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1b0d05f3: serviceaccount "payload-processing-e2e-ait-1b0d05f3" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1b0d05f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1b0d05f3-6646647789

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1b0d05f3-6646647789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1b0d05f3: serviceaccount "payload-processing-e2e-ait-1b0d05f3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1b0d05f3-6646647789

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

openshift-ingress

kubelet

payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

openshift-ingress

multus

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-1b0d05f3-6646647789-627hj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1b0d05f3-564cfbcd86-lvlfg

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-0e17d64c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-0e17d64c

openshift-ingress

kubelet

e2e-ait-1b0d05f3-openshift-default-678c988cf8-7rsxg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-0e17d64c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-0e17d64c-openshift-default-5798fb6776 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-0e17d64c-openshift-default-5798fb6776

SuccessfulCreate

Created pod: e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

openshift-ingress

multus

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-0e17d64c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-0e17d64c-6665bcd7c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-0e17d64c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0e17d64c: serviceaccount "payload-processing-e2e-derive-0e17d64c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0e17d64c-6665bcd7c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-0e17d64c-6665bcd7c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-0e17d64c-6665bcd7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-0e17d64c: serviceaccount "payload-processing-e2e-derive-0e17d64c" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-944e93-6785b44586-gxhw9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-944e93-55f85bfb4f-5mnkp

Killing

Stopping container payload-processing
(x6)

openshift-ingress

kubelet

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-explicit-557c41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-557c41

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-557c41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-557c41-openshift-default-85fddd4c44 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-557c41-openshift-default-85fddd4c44

SuccessfulCreate

Created pod: e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

openshift-ingress

kubelet

payload-processing-e2e-derive-0e17d64c-6665bcd7c-rnjx2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-0e17d64c-openshift-default-5798fb6776-tqrrw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-0e17d64c-b76cfc5f4-24nxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-944e93-openshift-default-777cdf84fd-52k6f

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-557c41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-557c41-5bbb55c74b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-557c41: serviceaccount "payload-processing-e2e-explicit-557c41" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-557c41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-557c41-6c9c5df76f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-557c41-6c9c5df76f

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-557c41-6c9c5df76f

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-557c41-6c9c5df76f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-557c41: serviceaccount "payload-processing-e2e-explicit-557c41" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:50048->10.133.0.51:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:50048->10.133.0.51:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-557c41-5bbb55c74b-t7ddj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-557c41-6c9c5df76f-znlp8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-557c41-openshift-default-85fddd4c44-xrfh6

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-ce78b8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-ce78b8

openshift-ingress

deployment-controller

e2e-noten-ce78b8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-ce78b8-openshift-default-5b85f9b8db from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-ce78b8-openshift-default-5b85f9b8db

SuccessfulCreate

Created pod: e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

openshift-ingress

kubelet

e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-2d69ee02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b

SuccessfulCreate

Created pod: e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

openshift-ingress

gateway_labeler_controller

e2e-mt-2d69ee02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2d69ee02

openshift-ingress

multus

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2d69ee02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2d69ee02: serviceaccount "payload-processing-e2e-mt-2d69ee02" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2d69ee02-75547dc497

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2d69ee02-75547dc497

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2d69ee02-75547dc497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2d69ee02: serviceaccount "payload-processing-e2e-mt-2d69ee02" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2d69ee02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2d69ee02-75547dc497 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": read tcp 10.133.0.2:37230->10.133.0.55:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": read tcp 10.133.0.2:37230->10.133.0.55:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-ce78b8-openshift-default-5b85f9b8db-kmrf2

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-00a938-7c4889dcdb-hdn9t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-00a938-6b958b6b47-4vv8s

Unhealthy

Readiness probe failed: dial tcp 10.132.0.44:9004: i/o timeout

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-00a938-openshift-default-678576d748-nz8ht

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2d69ee02-6dd4b696c8-5nhpx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2d69ee02-75547dc497-r5jwc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5d685d-568dbccf98-7992f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5d685d-8464b8954c-jscnj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2d69ee02-openshift-default-7f9bcdbb7b-fqcx2

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-5d685d-openshift-default-bcd55c84-hp9tr

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-9d031d-openshift-default-5997984458

SuccessfulCreate

Created pod: e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

openshift-ingress

deployment-controller

e2e-shared-a-w3-9d031d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-9d031d-openshift-default-5997984458 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-9d031d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-9d031d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-9d031d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-9d031d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-9d031d-d78b45789 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d: serviceaccount "payload-processing-e2e-shared-a-w3-9d031d" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9d031d-d78b45789

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-9d031d-d78b45789-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-9d031d: serviceaccount "payload-processing-e2e-shared-a-w3-9d031d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-9d031d-d78b45789

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-68ec26

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-68ec26

openshift-ingress

deployment-controller

e2e-shared-a-w2-68ec26-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8

SuccessfulCreate

Created pod: e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

openshift-ingress

multus

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-68ec26

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-68ec26

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-68ec26-57899966c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-68ec26-57899966c7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26: serviceaccount "payload-processing-e2e-shared-a-w2-68ec26" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-68ec26-57899966c7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-68ec26-57899966c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-68ec26: serviceaccount "payload-processing-e2e-shared-a-w2-68ec26" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

ProbeError

Readiness probe error: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Unhealthy

Readiness probe failed: Get "http://10.132.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Unhealthy

Startup probe failed: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

ProbeError

Startup probe error: Get "http://10.132.0.68:15021/healthz/ready": dial tcp 10.132.0.68:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:48100->10.133.0.57:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:48100->10.133.0.57:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d

SuccessfulCreate

Created pod: e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-shared-b-w3-c158b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-c158b2-openshift-default-95b6c476d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-c158b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-c158b2

openshift-ingress

multus

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c158b2: serviceaccount "payload-processing-e2e-shared-b-w3-c158b2" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c158b2: serviceaccount "payload-processing-e2e-shared-b-w3-c158b2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-c158b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-c158b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-604323

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-604323

openshift-ingress

replicaset-controller

e2e-shared-b-w2-604323-openshift-default-5756576dd

SuccessfulCreate

Created pod: e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

openshift-ingress

deployment-controller

e2e-shared-b-w2-604323-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-604323-openshift-default-5756576dd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-604323

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-604323-bf5b68db7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-604323-bf5b68db7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-604323-bf5b68db7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-604323-bf5b68db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-604323: serviceaccount "payload-processing-e2e-shared-b-w2-604323" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-604323: serviceaccount "payload-processing-e2e-shared-b-w2-604323" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-604323

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-mt-0347a9fa

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-0347a9fa-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-0347a9fa-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-mt-0347a9fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-0347a9fa

openshift-ingress

multus

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-0347a9fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-0347a9fa-openshift-default-b67899c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-0347a9fa-openshift-default-b67899c6

SuccessfulCreate

Created pod: e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0347a9fa-568c7b6445

FailedCreate

Error creating: pods "payload-processing-e2e-mt-0347a9fa-568c7b6445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0347a9fa: serviceaccount "payload-processing-e2e-mt-0347a9fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-0347a9fa-568c7b6445

SuccessfulCreate

Created pod: payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

openshift-ingress

deployment-controller

payload-processing-e2e-mt-0347a9fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-0347a9fa-568c7b6445 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-0347a9fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-0347a9fa: serviceaccount "payload-processing-e2e-mt-0347a9fa" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-0347a9fa-c666ffb5d-zr5cw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-0347a9fa-568c7b6445-lcdmx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-0347a9fa-openshift-default-b67899c6-9kxqx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-api-a-a7eaac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a7eaac-openshift-default-549f686644 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-a7eaac-openshift-default-549f686644

SuccessfulCreate

Created pod: e2e-api-a-a7eaac-openshift-default-549f686644-9472b

openshift-ingress

gateway_labeler_controller

e2e-api-a-a7eaac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a7eaac

openshift-ingress

multus

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a7eaac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a7eaac-68fd486df8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a7eaac: serviceaccount "payload-processing-e2e-api-a-a7eaac" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a7eaac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a7eaac-56c7fc6ff5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a7eaac: serviceaccount "payload-processing-e2e-api-a-a7eaac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-4c6f83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4c6f83-openshift-default-7d48c8bbdb from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb

SuccessfulCreate

Created pod: e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

openshift-ingress

gateway_labeler_controller

e2e-api-b-4c6f83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4c6f83

openshift-ingress

multus

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4c6f83: serviceaccount "payload-processing-e2e-api-b-4c6f83" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4c6f83-5f8976cf65

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4c6f83-5f8976cf65

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4c6f83-5f8976cf65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4c6f83: serviceaccount "payload-processing-e2e-api-b-4c6f83" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4c6f83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4c6f83-5f8976cf65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4c6f83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-a7eaac-56c7fc6ff5-6dfvn

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-a7eaac

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-a7eaac: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-a7eaac": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-a7eaac, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d9c6f6d5-df22-43e9-9f5b-0546a3f0841a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a7eaac-68fd486df8-vfdw2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-a7eaac-openshift-default-549f686644-9472b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4c6f83-7c44947bc8-thqqz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4c6f83-5f8976cf65-m5mq9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-4c6f83-openshift-default-7d48c8bbdb-qhkk6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-68ec26-fc57dc9c8-xgqjb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-68ec26-57899966c7-jvr8x

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4

SuccessfulCreate

Created pod: e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-ef4b62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-ef4b62

openshift-ingress

deployment-controller

e2e-ipp-a-ef4b62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4 from 0 to 1

openshift-ingress

multus

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-ef4b62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-ef4b62-647b4445b7 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-68ec26-openshift-default-7dc785bff8-c2v7r

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ef4b62: serviceaccount "payload-processing-e2e-ipp-a-ef4b62" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-ef4b62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ef4b62-647b4445b7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-ef4b62-647b4445b7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-ef4b62: serviceaccount "payload-processing-e2e-ipp-a-ef4b62" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-ef4b62-647b4445b7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-604323-bf5b68db7-9lvsl

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-604323

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-604323": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-604323, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f993a3d1-2803-4e66-bf65-979311bbd243, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-604323-776bb8c954-5pqvq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-604323-openshift-default-5756576dd-kvjnh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-85dc29-openshift-default-58f665bb5d

SuccessfulCreate

Created pod: e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

openshift-ingress

deployment-controller

e2e-ipp-b-85dc29-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-85dc29-openshift-default-58f665bb5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-85dc29

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-85dc29

openshift-ingress

multus

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-85dc29: serviceaccount "payload-processing-e2e-ipp-b-85dc29" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-85dc29

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-85dc29-59cb57985c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-85dc29-59cb57985c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-85dc29-59cb57985c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-85dc29-59cb57985c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-85dc29: serviceaccount "payload-processing-e2e-ipp-b-85dc29" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-85dc29

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-27c12d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-27c12d

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94

SuccessfulCreate

Created pod: e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

openshift-ingress

multus

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-cleanup-27c12d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d: serviceaccount "payload-processing-e2e-ipp-cleanup-27c12d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-27c12d: serviceaccount "payload-processing-e2e-ipp-cleanup-27c12d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-27c12d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-27c12d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

ProbeError

Startup probe error: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Unhealthy

Startup probe failed: Get "http://10.132.0.90:15021/healthz/ready": dial tcp 10.132.0.90:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-27c12d-cc6f9d9f7-v5rjs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-27c12d-57bfd4c754-s8f86

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-27c12d-openshift-default-6b8994dc94-8f59b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-ef4b62-647b4445b7-6rtvj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-ef4b62-85d4584f74-w6krj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-ef4b62-openshift-default-5d4d9f69d4-f2r9q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-85dc29-6f8cdbdd7d-dzg2v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-85dc29-59cb57985c-77vr6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-85dc29-openshift-default-58f665bb5d-4nt4k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-9d031d-d78b45789-bbpxh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-9d031d-7478577b86-5mhpn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-9d031d-openshift-default-5997984458-lt7hz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c158b2-5c74d58bdc-jn6vc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c158b2-6946b79fbb-652w8

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-c158b2

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-c158b2": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c158b2, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b7865f36-9383-474e-86c0-7f2a1e8592e0, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-c158b2-openshift-default-95b6c476d-pxb5q

Killing

Stopping container istio-proxy