Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7 to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5 to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw to ip-10-0-132-120.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-v962d

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-v962d to ip-10-0-132-120.ec2.internal

openshift-ingress

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e689e5-5745678df9-5845n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e689e5-5745678df9-5845n to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52 to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5 to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6 to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k to ip-10-0-128-123.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-shxpm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-shxpm to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7 to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9 to ip-10-0-128-123.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759 to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4 to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt to ip-10-0-128-123.ec2.internal

openshift-ingress

kube-auth-proxy-7d79898bc9-vqnp5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d79898bc9-vqnp5 to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6 to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a743146e-openshift-default-55ffcf656-46rxq to ip-10-0-132-120.ec2.internal

openshift-ingress

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t to ip-10-0-132-120.ec2.internal

openshift-ingress

router-default-5ff77fd8c6-khqvt

Scheduled

Successfully assigned openshift-ingress/router-default-5ff77fd8c6-khqvt to ip-10-0-136-124.ec2.internal

openshift-ingress

router-default-5ff77fd8c6-khqvt

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-5b54b7fbb7-4z9lb

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-4z9lb to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a743146e-df6bb76f-pswb2 to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9 to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9 to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6 to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-mt-adb97937-openshift-default-789597df96-x767q

Scheduled

Successfully assigned openshift-ingress/e2e-mt-adb97937-openshift-default-789597df96-x767q to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-2zpjm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-2zpjm to ip-10-0-128-123.ec2.internal

openshift-ingress

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp to ip-10-0-132-120.ec2.internal

openshift-ingress

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w to ip-10-0-132-120.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82 to ip-10-0-128-123.ec2.internal

openshift-ingress

kube-auth-proxy-7d79898bc9-j4nvg

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d79898bc9-j4nvg to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67 to ip-10-0-128-123.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-s4dvn to ip-10-0-132-120.ec2.internal

openshift-ingress

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

Scheduled

Successfully assigned openshift-ingress/e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z to ip-10-0-136-124.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc to ip-10-0-128-123.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f to ip-10-0-136-124.ec2.internal

openshift-ingress

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv to ip-10-0-132-120.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-5ff77fd8c6 from 0 to 1
(x13)

openshift-ingress

replicaset-controller

router-default-5ff77fd8c6

FailedCreate

Error creating: pods "router-default-5ff77fd8c6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-5ff77fd8c6

FailedCreate

Error creating: pods "router-default-5ff77fd8c6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-5ff77fd8c6

SuccessfulCreate

Created pod: router-default-5ff77fd8c6-khqvt
(x6)

openshift-ingress

kubelet

router-default-5ff77fd8c6-khqvt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-5ff77fd8c6-khqvt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-5ff77fd8c6-khqvt

AddedInterface

Add eth0 [10.132.0.14/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-5ff77fd8c6-khqvt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-5ff77fd8c6-khqvt

Created

Created container: router

openshift-ingress

kubelet

router-default-5ff77fd8c6-khqvt

Started

Started container router

openshift-ingress

replicaset-controller

kube-auth-proxy-7d79898bc9

SuccessfulCreate

Created pod: kube-auth-proxy-7d79898bc9-j4nvg

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d79898bc9 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7d79898bc9

SuccessfulCreate

Created pod: kube-auth-proxy-7d79898bc9-vqnp5
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d79898bc9

FailedCreate

Error creating: pods "kube-auth-proxy-7d79898bc9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-j4nvg

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d79898bc9-j4nvg

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7d79898bc9-vqnp5

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-vqnp5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-shxpm

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-shxpm

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-vqnp5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.59s (2.59s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-vqnp5

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-vqnp5

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-j4nvg

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-j4nvg

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d79898bc9-j4nvg

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.588s (2.588s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.723s (3.723s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

Created

Created container: discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-kx759

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.793s (2.793s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v962d

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-v962d

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-v962d

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v962d

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.124s (2.124s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v962d

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v962d

Started

Started container discovery
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v962d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-v962d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-shxpm

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-shxpm

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-s4dvn

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-4z9lb
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-2zpjm

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zpjm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-4z9lb

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4z9lb

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-2zpjm

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zpjm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.37s (1.37s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4z9lb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4z9lb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.363s (1.363s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zpjm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-2zpjm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-4z9lb

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-s4dvn

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w4-e33b3f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-e33b3f-openshift-default-5fff946fc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6

SuccessfulCreate

Created pod: e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

openshift-ingress

replicaset-controller

e2e-worker-w0-780e10-openshift-default-7d8764594b

SuccessfulCreate

Created pod: e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

openshift-ingress

deployment-controller

e2e-worker-w0-780e10-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-780e10-openshift-default-7d8764594b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-780e10

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-780e10

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-e33b3f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-e33b3f

openshift-ingress

gateway_labeler_controller

e2e-inf-a-78e52a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-78e52a

openshift-ingress

deployment-controller

e2e-inf-a-78e52a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-78e52a-openshift-default-7577f96958 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-78e52a-openshift-default-7577f96958

SuccessfulCreate

Created pod: e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

openshift-ingress

multus

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-780e10-86946c5ff7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-780e10

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-780e10-86946c5ff7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-780e10-6448787554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-780e10-6448787554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-780e10: serviceaccount "payload-processing-e2e-worker-w0-780e10" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-780e10-6448787554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-780e10

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-780e10-6448787554 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-780e10-86946c5ff7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-780e10-86946c5ff7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-780e10: serviceaccount "payload-processing-e2e-worker-w0-780e10" not found

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-78e52a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-78e52a-556c64d874 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-78e52a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-78e52a-86c977d8c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-78e52a-86c977d8c7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-78e52a-556c64d874

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-78e52a-556c64d874-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-78e52a: serviceaccount "payload-processing-e2e-inf-a-78e52a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-78e52a-86c977d8c7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-78e52a-86c977d8c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-78e52a: serviceaccount "payload-processing-e2e-inf-a-78e52a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-78e52a-556c64d874

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e33b3f-5759575df5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e33b3f: serviceaccount "payload-processing-e2e-worker-w4-e33b3f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-e33b3f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-e33b3f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-e33b3f-5759575df5 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-e33b3f-5759575df5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-e33b3f-5759575df5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-e33b3f: serviceaccount "payload-processing-e2e-worker-w4-e33b3f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-bde531

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-bde531

openshift-ingress

replicaset-controller

e2e-autores-bde531-openshift-default-5868fb98bb

SuccessfulCreate

Created pod: e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

openshift-ingress

deployment-controller

e2e-autores-bde531-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-bde531-openshift-default-5868fb98bb from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-0252b3a9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0252b3a9

openshift-ingress

deployment-controller

e2e-ait-0252b3a9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0252b3a9-openshift-default-5d75d899f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-0252b3a9-openshift-default-5d75d899f6

SuccessfulCreate

Created pod: e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.239s (4.239s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0252b3a9-fbbc5fc99

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0252b3a9-fbbc5fc99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0252b3a9: serviceaccount "payload-processing-e2e-ait-0252b3a9" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0252b3a9: serviceaccount "payload-processing-e2e-ait-0252b3a9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0252b3a9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0252b3a9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0252b3a9-fbbc5fc99 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0252b3a9-fbbc5fc99

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

openshift-ingress

multus

payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-autores-bde531

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-bde531-5ffc777dfc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-bde531-6bd8dfc894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-bde531-6bd8dfc894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-bde531-6bd8dfc894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-bde531: serviceaccount "payload-processing-e2e-autores-bde531" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-bde531-5ffc777dfc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-bde531-5ffc777dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-bde531: serviceaccount "payload-processing-e2e-autores-bde531" not found

openshift-ingress

kubelet

payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-bde531

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-bde531-6bd8dfc894 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-bde531-5ffc777dfc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Unhealthy

Readiness probe failed: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

ProbeError

Readiness probe error: Get "http://10.134.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e689e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e689e5

openshift-ingress

replicaset-controller

e2e-inf-b-e689e5-openshift-default-75bb4458c6

SuccessfulCreate

Created pod: e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

openshift-ingress

deployment-controller

e2e-inf-b-e689e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e689e5-openshift-default-75bb4458c6 from 0 to 1

openshift-ingress

multus

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e689e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e689e5-5745678df9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e689e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e689e5: serviceaccount "payload-processing-e2e-inf-b-e689e5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e689e5-5745678df9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e689e5-5745678df9-5845n
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e689e5-5745678df9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e689e5-5745678df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e689e5: serviceaccount "payload-processing-e2e-inf-b-e689e5" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e689e5-5745678df9-5845n

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e689e5-5745678df9-5845n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e689e5-5745678df9-5845n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-e689e5-5745678df9-5845n

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0252b3a9-844c6cb4d6-5vz4f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0252b3a9-fbbc5fc99-4wm82

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-0252b3a9-openshift-default-5d75d899f6-59xhw

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

GatewayAuthBootstrap

e2e-migrate-8dd97f83-gw

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-migrate-8dd97f83-gw-authn-ssl: envoyfilters.networking.istio.io "e2e-migrate-8dd97f83-gw-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996

SuccessfulCreate

Created pod: e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

openshift-ingress

multus

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-migrate-8dd97f83-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-8dd97f83-gw

openshift-ingress

deployment-controller

e2e-migrate-8dd97f83-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

ProbeError

Startup probe error: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.627s (2.627s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8dd97f83-6547bfd76b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-8dd97f83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-8dd97f83-6547bfd76b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-8dd97f83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8dd97f83: serviceaccount "payload-processing-e2e-migrate-8dd97f83" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-8dd97f83-6547bfd76b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-8dd97f83-6547bfd76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-8dd97f83: serviceaccount "payload-processing-e2e-migrate-8dd97f83" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-8dd97f83-86449d89bb-p594b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-8dd97f83-6547bfd76b-pkmnt

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-ec2b25e3-openshift-default-7887bdc44b

SuccessfulCreate

Created pod: e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

openshift-ingress

multus

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-ec2b25e3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ec2b25e3-openshift-default-7887bdc44b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-ec2b25e3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ec2b25e3

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-8dd97f83-gw-openshift-default-6b89b95996-btdst

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ec2b25e3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ec2b25e3-7fcd8ff845 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ec2b25e3: serviceaccount "payload-processing-e2e-ait-ec2b25e3" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ec2b25e3: serviceaccount "payload-processing-e2e-ait-ec2b25e3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ec2b25e3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-ec2b25e3-7fcd8ff845-48s4j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ec2b25e3-75b4bf94-sdwn6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ec2b25e3-openshift-default-7887bdc44b-wljxf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-eb086ade-openshift-default-5f58886d7b

SuccessfulCreate

Created pod: e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

openshift-ingress

gateway_labeler_controller

e2e-derive-eb086ade

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-eb086ade

openshift-ingress

deployment-controller

e2e-derive-eb086ade-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-eb086ade-openshift-default-5f58886d7b from 0 to 1

openshift-ingress

multus

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-derive-eb086ade

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-eb086ade-7b79f896df from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-eb086ade-7b79f896df

SuccessfulCreate

Created pod: payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

openshift-ingress

kubelet

payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-eb086ade

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

openshift-ingress

multus

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-eb086ade: serviceaccount "payload-processing-e2e-derive-eb086ade" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-eb086ade-7b79f896df

FailedCreate

Error creating: pods "payload-processing-e2e-derive-eb086ade-7b79f896df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-eb086ade: serviceaccount "payload-processing-e2e-derive-eb086ade" not found

openshift-ingress

multus

payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-bde531-6bd8dfc894-ng8mt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-bde531-5ffc777dfc-nm92k

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-eb086ade-7b79f896df-bgv52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-eb086ade-5c76b48c7d-9tswb

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-eb086ade-openshift-default-5f58886d7b-grj5z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-230a34-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-230a34-openshift-default-7c4479fbb4 from 0 to 1

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-230a34-openshift-default-7c4479fbb4

SuccessfulCreate

Created pod: e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

openshift-ingress

gateway_labeler_controller

e2e-explicit-230a34

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-230a34

openshift-ingress

multus

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-bde531-openshift-default-5868fb98bb-nvbt9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-230a34: serviceaccount "payload-processing-e2e-explicit-230a34" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-230a34-7d75f7dd65

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-230a34-7d75f7dd65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-230a34: serviceaccount "payload-processing-e2e-explicit-230a34" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-230a34

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-230a34-7d75f7dd65

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-230a34

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-230a34-7d75f7dd65 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-a743146e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a743146e-openshift-default-55ffcf656 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-a743146e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a743146e

openshift-ingress

replicaset-controller

e2e-mt-a743146e-openshift-default-55ffcf656

SuccessfulCreate

Created pod: e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

openshift-ingress

multus

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a743146e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a743146e-df6bb76f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a743146e-df6bb76f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a743146e-df6bb76f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a743146e: serviceaccount "payload-processing-e2e-mt-a743146e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a743146e: serviceaccount "payload-processing-e2e-mt-a743146e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a743146e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a743146e-7f4df85f5d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

openshift-ingress

kubelet

payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a743146e-df6bb76f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

ProbeError

Startup probe error: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Unhealthy

Startup probe failed: Get "http://10.134.0.52:15021/healthz/ready": dial tcp 10.134.0.52:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-a743146e-df6bb76f-pswb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a743146e-7f4df85f5d-2skh5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-a743146e-openshift-default-55ffcf656-46rxq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-230a34-7d75f7dd65-fchr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-230a34-5b4c47b7b6-tkrlm

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-05b216

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-05b216

openshift-ingress

deployment-controller

e2e-shared-a-w2-05b216-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-05b216-openshift-default-58b6755498 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-05b216-openshift-default-58b6755498

SuccessfulCreate

Created pod: e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

openshift-ingress

multus

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-05b216: serviceaccount "payload-processing-e2e-shared-a-w2-05b216" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-05b216-848b9d6869

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-05b216

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-05b216-848b9d6869 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-05b216

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-05b216-848b9d6869

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-05b216-848b9d6869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-05b216: serviceaccount "payload-processing-e2e-shared-a-w2-05b216" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-noten-f4d89a-openshift-default-6b4bfc8844

SuccessfulCreate

Created pod: e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

openshift-ingress

gateway_labeler_controller

e2e-noten-f4d89a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f4d89a

openshift-ingress

deployment-controller

e2e-noten-f4d89a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f4d89a-openshift-default-6b4bfc8844 from 0 to 1

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-ba69d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-ba69d2

openshift-ingress

deployment-controller

e2e-shared-b-w2-ba69d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964

SuccessfulCreate

Created pod: e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-230a34-openshift-default-7c4479fbb4-f97ll

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-ba69d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2: serviceaccount "payload-processing-e2e-shared-b-w2-ba69d2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-ba69d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-ba69d2: serviceaccount "payload-processing-e2e-shared-b-w2-ba69d2" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-78e52a-556c64d874-vsdst

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-adb97937

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-adb97937

openshift-ingress

kubelet

payload-processing-e2e-inf-a-78e52a-86c977d8c7-k9m67

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-mt-adb97937-openshift-default-789597df96

SuccessfulCreate

Created pod: e2e-mt-adb97937-openshift-default-789597df96-x767q

openshift-ingress

deployment-controller

e2e-mt-adb97937-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-adb97937-openshift-default-789597df96 from 0 to 1

openshift-ingress

multus

e2e-mt-adb97937-openshift-default-789597df96-x767q

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-adb97937-8644758594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-adb97937-8644758594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-adb97937: serviceaccount "payload-processing-e2e-mt-adb97937" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-adb97937-8644758594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd
(x7)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-adb97937-7f847ff7b9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-adb97937-7f847ff7b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-adb97937: serviceaccount "payload-processing-e2e-mt-adb97937" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-adb97937

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-adb97937-7f847ff7b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-adb97937

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-adb97937-8644758594 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-adb97937-7f847ff7b9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

openshift-ingress

kubelet

payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-78e52a-openshift-default-7577f96958-8snlp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e689e5-5745678df9-5845n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e689e5-669cdb9c66-4sdg7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-b-e689e5-openshift-default-75bb4458c6-dj74t

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-d28bd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd

SuccessfulCreate

Created pod: e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-d28bd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-d28bd5
(x5)

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-f4d89a-openshift-default-6b4bfc8844-c992j

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-d28bd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-d28bd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5: serviceaccount "payload-processing-e2e-shared-a-w3-d28bd5" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-d28bd5: serviceaccount "payload-processing-e2e-shared-a-w3-d28bd5" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Unhealthy

Startup probe failed: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

ProbeError

Startup probe error: Get "http://10.134.0.57:15021/healthz/ready": dial tcp 10.134.0.57:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-cadcf4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-cadcf4

openshift-ingress

deployment-controller

e2e-shared-b-w3-cadcf4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d

SuccessfulCreate

Created pod: e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

openshift-ingress

multus

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-cadcf4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-cadcf4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-cadcf4: serviceaccount "payload-processing-e2e-shared-b-w3-cadcf4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-cadcf4: serviceaccount "payload-processing-e2e-shared-b-w3-cadcf4" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-adb97937-7f847ff7b9-qmkj9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-adb97937-8644758594-68ftd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-adb97937-openshift-default-789597df96-x767q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-079e6e-openshift-default-66d7bd6f8d

SuccessfulCreate

Created pod: e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

openshift-ingress

deployment-controller

e2e-api-a-079e6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-079e6e-openshift-default-66d7bd6f8d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-079e6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-079e6e

openshift-ingress

multus

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-079e6e-65cffc6767

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-079e6e-65cffc6767

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-079e6e-65cffc6767-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-079e6e: serviceaccount "payload-processing-e2e-api-a-079e6e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-079e6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-079e6e: serviceaccount "payload-processing-e2e-api-a-079e6e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-079e6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-079e6e-65cffc6767 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-780e10-86946c5ff7-mtdpr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-780e10-6448787554-2rk4d

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-api-b-eecd90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-eecd90

openshift-ingress

GatewayAuthBootstrap

e2e-api-b-eecd90

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-api-b-eecd90-authn-ssl: envoyfilters.networking.istio.io "e2e-api-b-eecd90-authn-ssl" already exists

openshift-ingress

kubelet

e2e-worker-w0-780e10-openshift-default-7d8764594b-24lpg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-eecd90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-eecd90-openshift-default-59d4c7d7fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-eecd90-openshift-default-59d4c7d7fd

SuccessfulCreate

Created pod: e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

openshift-ingress

multus

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-eecd90: serviceaccount "payload-processing-e2e-api-b-eecd90" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-eecd90-5f56c75db5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-eecd90-5f56c75db5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-eecd90-5f56c75db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-eecd90: serviceaccount "payload-processing-e2e-api-b-eecd90" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-eecd90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-eecd90-79b6b476fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-eecd90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-eecd90-5f56c75db5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

AddedInterface

Add eth0 [10.133.0.87/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9

AddedInterface

Add eth0 [10.133.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

ProbeError

Readiness probe error: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:52488->10.134.0.64:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Unhealthy

Readiness probe failed: Get "http://10.134.0.64:15021/healthz/ready": read tcp 10.134.0.2:52488->10.134.0.64:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

ProbeError

Startup probe error: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Unhealthy

Startup probe failed: Get "http://10.134.0.64:15021/healthz/ready": dial tcp 10.134.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-079e6e-65cffc6767-xsldx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-079e6e-5f7b8758b6-8gfgb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-079e6e-openshift-default-66d7bd6f8d-pwnzg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-e33b3f-5759575df5-nzsns

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-e33b3f-7d794d57c4-94tgc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-eecd90-79b6b476fd-x8njq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-eecd90-5f56c75db5-ccfs9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-e33b3f-openshift-default-5fff946fc6-pvlwh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-eecd90-openshift-default-59d4c7d7fd-q4p5n

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-05b216-86888dc566-x2b8f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-05b216-848b9d6869-dkb8m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-05b216-openshift-default-58b6755498-lzh8m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-ba69d2-78fffc8979-nw6k5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-ba69d2-9b4b5c9db-46mx6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-ba69d2-openshift-default-f95b7f964-b7r4w

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-91f4ab

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-91f4ab

openshift-ingress

deployment-controller

e2e-ipp-a-91f4ab-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-91f4ab-openshift-default-d66844f5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-91f4ab-openshift-default-d66844f5b

SuccessfulCreate

Created pod: e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

openshift-ingress

multus

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-91f4ab

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-91f4ab: serviceaccount "payload-processing-e2e-ipp-a-91f4ab" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-91f4ab

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-91f4ab: serviceaccount "payload-processing-e2e-ipp-a-91f4ab" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd

AddedInterface

Add eth0 [10.133.0.98/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": read tcp 10.132.0.2:36362->10.132.0.85:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": read tcp 10.132.0.2:36362->10.132.0.85:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused

openshift-ingress

multus

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-b-438a9b-openshift-default-84d94464b

SuccessfulCreate

Created pod: e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-438a9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-438a9b

openshift-ingress

deployment-controller

e2e-ipp-b-438a9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-438a9b-openshift-default-84d94464b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-438a9b-6946c5b445

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-438a9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-438a9b-6946c5b445 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-438a9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-438a9b-6946c5b445

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-438a9b-6946c5b445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-438a9b: serviceaccount "payload-processing-e2e-ipp-b-438a9b" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-438a9b: serviceaccount "payload-processing-e2e-ipp-b-438a9b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl

AddedInterface

Add eth0 [10.133.0.99/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-5fdb6e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-5fdb6e

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

openshift-ingress

deployment-controller

e2e-ipp-cleanup-5fdb6e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-5fdb6e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-5fdb6e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5fdb6e: serviceaccount "payload-processing-e2e-ipp-cleanup-5fdb6e" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5fdb6e: serviceaccount "payload-processing-e2e-ipp-cleanup-5fdb6e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fdb6e-564d84985d-qpd8x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fdb6e-848d8977ff-g9c2k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-5fdb6e-openshift-default-656959467b-wchbz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-91f4ab-7d967d8ff9-5tltd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-91f4ab-8685dd8ddb-jhnv4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-91f4ab-openshift-default-d66844f5b-rxrvg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-438a9b-84f5db845d-bmrnl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-438a9b-6946c5b445-f42j6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-438a9b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-438a9b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-438a9b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-438a9b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2b167559-027a-4f96-84fd-147240b51ec6, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-438a9b-openshift-default-84d94464b-76fhx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-d28bd5-549777cbb-tdxgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-d28bd5-668c8bb589-gcw8f

Unhealthy

Readiness probe failed: dial tcp 10.132.0.79:9004: i/o timeout

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-d28bd5-openshift-default-df68dd7fd-wghdv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-cadcf4-9cb96d5bc-cr9gs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-cadcf4-c7c96b846-j2whp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-cadcf4-openshift-default-54f7b4c96d-xhtng

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503