Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-68183c-8c86449-cd6kd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-68183c-8c86449-cd6kd to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8 to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Scheduled

Successfully assigned openshift-ingress/e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99 to ip-10-0-136-184.ec2.internal

openshift-ingress

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-zvgmc

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zvgmc to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225 to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-noten-0c1110-openshift-default-58659488d4-t86f6

Scheduled

Successfully assigned openshift-ingress/e2e-noten-0c1110-openshift-default-58659488d4-t86f6 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47 to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg to ip-10-0-136-184.ec2.internal

openshift-ingress

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5 to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6 to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj to ip-10-0-136-184.ec2.internal

openshift-ingress

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v to ip-10-0-136-184.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

Scheduled

Successfully assigned openshift-ingress/e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj to ip-10-0-137-53.ec2.internal

openshift-ingress

kube-auth-proxy-7c6769664b-6wdck

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c6769664b-6wdck to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-9x9j4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-9x9j4 to ip-10-0-137-53.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-znmmb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-znmmb to ip-10-0-137-53.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-f2vqq

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-f2vqq to ip-10-0-136-184.ec2.internal

openshift-ingress

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1a095586-openshift-default-df7756fbd-d2frn to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67 to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d to ip-10-0-136-184.ec2.internal

openshift-ingress

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb to ip-10-0-137-53.ec2.internal

openshift-ingress

kube-auth-proxy-7c6769664b-zvgzb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c6769664b-zvgzb to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw to ip-10-0-136-184.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1a095586-8677c674bf-tphqs to ip-10-0-131-146.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-s7nd9

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-s7nd9 to ip-10-0-136-184.ec2.internal

openshift-ingress

router-default-68854cb984-hm4cb

Scheduled

Successfully assigned openshift-ingress/router-default-68854cb984-hm4cb to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6 to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94 to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p to ip-10-0-136-184.ec2.internal

openshift-ingress

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Scheduled

Successfully assigned openshift-ingress/e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm to ip-10-0-137-53.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s to ip-10-0-131-146.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82 to ip-10-0-131-146.ec2.internal

openshift-ingress

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn to ip-10-0-137-53.ec2.internal

openshift-ingress

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt to ip-10-0-137-53.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-68854cb984 from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-68854cb984

FailedCreate

Error creating: pods "router-default-68854cb984-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-68854cb984

FailedCreate

Error creating: pods "router-default-68854cb984-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-68854cb984

SuccessfulCreate

Created pod: router-default-68854cb984-hm4cb
(x6)

openshift-ingress

kubelet

router-default-68854cb984-hm4cb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-68854cb984-hm4cb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-68854cb984-hm4cb

Created

Created container: router

openshift-ingress

kubelet

router-default-68854cb984-hm4cb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-68854cb984-hm4cb

Started

Started container router

openshift-ingress

multus

router-default-68854cb984-hm4cb

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-zvgzb

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6769664b

FailedCreate

Error creating: pods "kube-auth-proxy-7c6769664b-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6769664b

SuccessfulCreate

Created pod: kube-auth-proxy-7c6769664b-zvgzb

openshift-ingress

replicaset-controller

kube-auth-proxy-7c6769664b

SuccessfulCreate

Created pod: kube-auth-proxy-7c6769664b-6wdck

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7c6769664b from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7c6769664b-zvgzb

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-6wdck

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7c6769664b-6wdck

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-zvgzb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-f2vqq

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-f2vqq

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-zvgzb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-zvgzb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.512s (2.512s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-6wdck

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.798s (2.798s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-zvgzb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-6wdck

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c6769664b-6wdck

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.43s (3.43s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.281s (4.281s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cp7xpn

Created

Created container: istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-s7nd9

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s7nd9

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s7nd9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-s7nd9

Created

Created container: discovery

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-s7nd9

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-f2vqq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-f2vqq

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-znmmb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-znmmb

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-9x9j4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zvgmc

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9x9j4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zvgmc

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-9x9j4

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-zvgmc

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9x9j4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.593s (1.593s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9x9j4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-9x9j4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zvgmc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.813s (2.813s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zvgmc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zvgmc

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-znmmb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-znmmb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-znmmb

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-znmmb

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-znmmb

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4

SuccessfulCreate

Created pod: e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

openshift-ingress

replicaset-controller

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d

SuccessfulCreate

Created pod: e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

openshift-ingress

deployment-controller

e2e-worker-w0-1269b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-1269b2-openshift-default-7d5fd5748d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-fcd9f3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-fcd9f3

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-1269b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-1269b2

openshift-ingress

deployment-controller

e2e-worker-w4-fcd9f3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-181b16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-181b16

openshift-ingress

deployment-controller

e2e-inf-a-181b16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-181b16-openshift-default-d46d6599b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-181b16-openshift-default-d46d6599b

SuccessfulCreate

Created pod: e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

openshift-ingress

multus

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

openshift-ingress

multus

payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1269b2-fdd4895d7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-1269b2-fdd4895d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1269b2: serviceaccount "payload-processing-e2e-worker-w0-1269b2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-1269b2-fdd4895d7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-1269b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-1269b2-fdd4895d7 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-1269b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-1269b2: serviceaccount "payload-processing-e2e-worker-w0-1269b2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3: serviceaccount "payload-processing-e2e-worker-w4-fcd9f3" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-fcd9f3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-181b16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-181b16-bd664686c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-fcd9f3: serviceaccount "payload-processing-e2e-worker-w4-fcd9f3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-fcd9f3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-181b16-55c996cb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

openshift-ingress

multus

payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-181b16-55c996cb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-181b16-55c996cb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-181b16: serviceaccount "payload-processing-e2e-inf-a-181b16" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-181b16-bd664686c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-181b16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-181b16-55c996cb6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-181b16-bd664686c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-181b16-bd664686c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-181b16: serviceaccount "payload-processing-e2e-inf-a-181b16" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-ccd499b1-openshift-default-7849d679f8

SuccessfulCreate

Created pod: e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

openshift-ingress

gateway_labeler_controller

e2e-ait-ccd499b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ccd499b1

openshift-ingress

deployment-controller

e2e-ait-ccd499b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ccd499b1-openshift-default-7849d679f8 from 0 to 1

openshift-ingress

multus

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.501s (2.501s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-3f6f32

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-3f6f32

openshift-ingress

deployment-controller

e2e-autores-3f6f32-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-3f6f32-openshift-default-6dd4df7db from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-3f6f32-openshift-default-6dd4df7db

SuccessfulCreate

Created pod: e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

openshift-ingress

multus

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.734s (2.734s including waiting). Image size: 181318953 bytes.

openshift-ingress

multus

payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ccd499b1: serviceaccount "payload-processing-e2e-ait-ccd499b1" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ccd499b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ccd499b1-5c7c4cf645 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ccd499b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ccd499b1-5c7c4cf645

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ccd499b1-5c7c4cf645

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ccd499b1-5c7c4cf645-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ccd499b1: serviceaccount "payload-processing-e2e-ait-ccd499b1" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-3f6f32

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-3f6f32-796794d758 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3f6f32-76c5c496b9

FailedCreate

Error creating: pods "payload-processing-e2e-autores-3f6f32-76c5c496b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3f6f32: serviceaccount "payload-processing-e2e-autores-3f6f32" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3f6f32-76c5c496b9

SuccessfulCreate

Created pod: payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

openshift-ingress

deployment-controller

payload-processing-e2e-autores-3f6f32

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-3f6f32-76c5c496b9 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3f6f32-796794d758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

openshift-ingress

kubelet

payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3f6f32-796794d758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-3f6f32-796794d758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3f6f32: serviceaccount "payload-processing-e2e-autores-3f6f32" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

Created

Created container: payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-inf-b-9b8115

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-9b8115

openshift-ingress

deployment-controller

e2e-inf-b-9b8115-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-9b8115-openshift-default-75ddfc47d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-9b8115-openshift-default-75ddfc47d4

SuccessfulCreate

Created pod: e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

openshift-ingress

multus

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-9b8115

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-9b8115-5647f56859 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-9b8115

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-9b8115-698545b54b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9b8115-698545b54b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-9b8115-698545b54b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b8115: serviceaccount "payload-processing-e2e-inf-b-9b8115" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-9b8115-698545b54b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9b8115-5647f56859

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-9b8115-5647f56859

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-9b8115-5647f56859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-9b8115: serviceaccount "payload-processing-e2e-inf-b-9b8115" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ccd499b1-84c55ccbc4-lsc82

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-ccd499b1-openshift-default-dockercfg-mtqsv); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-ait-ccd499b1-5c7c4cf645-xmjrh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-9e4372d6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676

SuccessfulCreate

Created pod: e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

openshift-ingress

gateway_labeler_controller

e2e-migrate-9e4372d6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-9e4372d6-gw

openshift-ingress

kubelet

e2e-ait-ccd499b1-openshift-default-7849d679f8-r6vkr

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

multus

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-9e4372d6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-9e4372d6-87658f6db from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-9e4372d6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-9e4372d6-649d68cd9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9e4372d6-649d68cd9d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-9e4372d6-649d68cd9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9e4372d6: serviceaccount "payload-processing-e2e-migrate-9e4372d6" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-9e4372d6-649d68cd9d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

openshift-ingress

kubelet

payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-9e4372d6: serviceaccount "payload-processing-e2e-migrate-9e4372d6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

openshift-ingress

multus

payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-9e4372d6-87658f6db-bz9pv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-9e4372d6-649d68cd9d-rq6m5

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-60f59148

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-60f59148

openshift-ingress

deployment-controller

e2e-ait-60f59148-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-60f59148-openshift-default-f64fbdd6 from 0 to 1

openshift-ingress

kubelet

e2e-migrate-9e4372d6-gw-openshift-default-6448bc4676-xjvwj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ait-60f59148-openshift-default-f64fbdd6

SuccessfulCreate

Created pod: e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

openshift-ingress

multus

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-60f59148

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-60f59148-858dcbcd9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-60f59148-858dcbcd9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-60f59148-858dcbcd9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-60f59148: serviceaccount "payload-processing-e2e-ait-60f59148" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-60f59148

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-60f59148-65bc8d87c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-60f59148: serviceaccount "payload-processing-e2e-ait-60f59148" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-60f59148-858dcbcd9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Unhealthy

Readiness probe failed: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

ProbeError

Readiness probe error: Get "http://10.134.0.47:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60f59148-65bc8d87c8-zsqgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-60f59148-858dcbcd9-vnwdh

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-99500ae5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-99500ae5

openshift-ingress

kubelet

e2e-ait-60f59148-openshift-default-f64fbdd6-lbl8g

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-derive-99500ae5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-99500ae5-openshift-default-6467c844b4 from 0 to 1

openshift-ingress

multus

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-99500ae5-openshift-default-6467c844b4

SuccessfulCreate

Created pod: e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

openshift-ingress

deployment-controller

payload-processing-e2e-derive-99500ae5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-99500ae5-9f5c78649 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-99500ae5-9f5c78649

FailedCreate

Error creating: pods "payload-processing-e2e-derive-99500ae5-9f5c78649-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-99500ae5: serviceaccount "payload-processing-e2e-derive-99500ae5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-99500ae5-9f5c78649

SuccessfulCreate

Created pod: payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-99500ae5: serviceaccount "payload-processing-e2e-derive-99500ae5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-99500ae5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

openshift-ingress

kubelet

payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8

Created

Created container: payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-3f6f32

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-3f6f32: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-3f6f32": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-3f6f32, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 17fbf5fe-e108-469e-ab54-2bf8643b0ea8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f6f32-796794d758-5sscr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3f6f32-76c5c496b9-cl225

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-99500ae5-9f5c78649-dgdp8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-99500ae5-openshift-default-dockercfg-65jst); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-99500ae5-7c44c7d77d-b7f6n

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-99500ae5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-99500ae5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-99500ae5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-99500ae5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 50ee9bb7-dd52-4f27-86a9-1ebaa4296ab7, UID in object meta:

openshift-ingress

kubelet

e2e-derive-99500ae5-openshift-default-6467c844b4-dtlrj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-68183c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-68183c-openshift-default-56b46bfb7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-68183c-openshift-default-56b46bfb7b

SuccessfulCreate

Created pod: e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

openshift-ingress

gateway_labeler_controller

e2e-explicit-68183c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-68183c

openshift-ingress

multus

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-3f6f32-openshift-default-6dd4df7db-q9npm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-68183c-784c44d954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-68183c-8c86449

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-68183c-8c86449-cd6kd

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-68183c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-68183c-8c86449 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-68183c-8c86449

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-68183c-8c86449-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-68183c: serviceaccount "payload-processing-e2e-explicit-68183c" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-68183c-784c44d954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-68183c-784c44d954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-68183c: serviceaccount "payload-processing-e2e-explicit-68183c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-68183c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-68183c-784c44d954 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-68183c-8c86449-cd6kd

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-68183c-8c86449-cd6kd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-68183c-8c86449-cd6kd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-68183c-8c86449-cd6kd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-2137c903-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2137c903-openshift-default-c495b45cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-2137c903

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2137c903

openshift-ingress

multus

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-2137c903-openshift-default-c495b45cb

SuccessfulCreate

Created pod: e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

openshift-ingress

kubelet

payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2137c903

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2137c903-d5878779d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2137c903-d5878779d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2137c903-d5878779d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2137c903-d5878779d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2137c903: serviceaccount "payload-processing-e2e-mt-2137c903" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2137c903-bc8b46f45

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2137c903

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2137c903-bc8b46f45 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2137c903-bc8b46f45

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2137c903-bc8b46f45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2137c903: serviceaccount "payload-processing-e2e-mt-2137c903" not found

openshift-ingress

multus

payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2137c903-d5878779d-hzkpg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-2137c903-bc8b46f45-ksq67

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-2137c903-openshift-default-c495b45cb-8fgzt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-68183c-8c86449-cd6kd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-68183c-784c44d954-qfhhh

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-c98839

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-c98839

openshift-ingress

deployment-controller

e2e-shared-a-w2-c98839-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6

SuccessfulCreate

Created pod: e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

openshift-ingress

multus

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-0c1110

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-0c1110

openshift-ingress

kubelet

e2e-explicit-68183c-openshift-default-56b46bfb7b-r4rdf

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-0c1110-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-0c1110-openshift-default-58659488d4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-c98839

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c from 0 to 1

openshift-ingress

multus

e2e-noten-0c1110-openshift-default-58659488d4-t86f6

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-0c1110-openshift-default-58659488d4-t86f6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c98839: serviceaccount "payload-processing-e2e-shared-a-w2-c98839" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

openshift-ingress

replicaset-controller

e2e-noten-0c1110-openshift-default-58659488d4

SuccessfulCreate

Created pod: e2e-noten-0c1110-openshift-default-58659488d4-t86f6

openshift-ingress

kubelet

e2e-noten-0c1110-openshift-default-58659488d4-t86f6

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-c98839: serviceaccount "payload-processing-e2e-shared-a-w2-c98839" not found

openshift-ingress

kubelet

e2e-noten-0c1110-openshift-default-58659488d4-t86f6

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-c98839

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-b83f70-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-b83f70

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-b83f70

openshift-ingress

replicaset-controller

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb

SuccessfulCreate

Created pod: e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-b83f70

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70: serviceaccount "payload-processing-e2e-shared-b-w2-b83f70" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-b83f70: serviceaccount "payload-processing-e2e-shared-b-w2-b83f70" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-b83f70

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-1a095586

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1a095586

openshift-ingress

deployment-controller

e2e-mt-1a095586-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1a095586-openshift-default-df7756fbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-1a095586-openshift-default-df7756fbd

SuccessfulCreate

Created pod: e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

openshift-ingress

multus

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1a095586

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1a095586-8677c674bf from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a095586-69ccc47f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1a095586-69ccc47f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a095586: serviceaccount "payload-processing-e2e-mt-1a095586" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1a095586-69ccc47f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1a095586

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1a095586-69ccc47f78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a095586-8677c674bf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1a095586-8677c674bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1a095586: serviceaccount "payload-processing-e2e-mt-1a095586" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1a095586-8677c674bf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-181b16

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-181b16: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-181b16": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-181b16, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b5d2a13b-63a7-4740-b31e-9bda8ce13e56, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-181b16-55c996cb6-prk6x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-181b16-bd664686c-hq5fv

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-0c1110-openshift-default-58659488d4-t86f6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-181b16-openshift-default-d46d6599b-2fkkn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-9b8115-5647f56859-dql4v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-9b8115-698545b54b-npq4j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-9b8115-openshift-default-75ddfc47d4-nmhrw

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d

SuccessfulCreate

Created pod: e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

openshift-ingress

deployment-controller

e2e-shared-a-w3-cc3801-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-cc3801

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-cc3801

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-cc3801

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801: serviceaccount "payload-processing-e2e-shared-a-w3-cc3801" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-cc3801

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-cc3801: serviceaccount "payload-processing-e2e-shared-a-w3-cc3801" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4c29a2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4c29a2

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b

SuccessfulCreate

Created pod: e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

openshift-ingress

deployment-controller

e2e-shared-b-w3-4c29a2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

ProbeError

Startup probe error: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

Unhealthy

Startup probe failed: Get "http://10.132.0.81:15021/healthz/ready": dial tcp 10.132.0.81:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4c29a2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2: serviceaccount "payload-processing-e2e-shared-b-w3-4c29a2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4c29a2: serviceaccount "payload-processing-e2e-shared-b-w3-4c29a2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4c29a2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1a095586-8677c674bf-tphqs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1a095586-69ccc47f78-hqvq6

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

Unhealthy

Startup probe failed: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

ProbeError

Startup probe error: Get "http://10.132.0.83:15021/healthz/ready": dial tcp 10.132.0.83:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-mt-1a095586-openshift-default-df7756fbd-d2frn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-a954c8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-a954c8

openshift-ingress

deployment-controller

e2e-api-a-a954c8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-a954c8-openshift-default-6d4655bc96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-a954c8-openshift-default-6d4655bc96

SuccessfulCreate

Created pod: e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

openshift-ingress

multus

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a954c8-746bbd8478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-a954c8-746bbd8478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a954c8: serviceaccount "payload-processing-e2e-api-a-a954c8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-a954c8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-a954c8-5789fbd795 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a954c8-5789fbd795

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-a954c8-5789fbd795

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-a954c8-5789fbd795-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-a954c8: serviceaccount "payload-processing-e2e-api-a-a954c8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-a954c8-746bbd8478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-a954c8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-a954c8-746bbd8478 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-api-b-cf94fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cf94fd

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

ProbeError

Readiness probe error: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Unhealthy

Readiness probe failed: Get "http://10.132.0.87:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

multus

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-cf94fd-openshift-default-545595cdc4

SuccessfulCreate

Created pod: e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

openshift-ingress

deployment-controller

e2e-api-b-cf94fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cf94fd-openshift-default-545595cdc4 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cf94fd-6df5bf4d77

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cf94fd-6df5bf4d77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cf94fd: serviceaccount "payload-processing-e2e-api-b-cf94fd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cf94fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cf94fd-6df5bf4d77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cf94fd-6df5bf4d77

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cf94fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cf94fd: serviceaccount "payload-processing-e2e-api-b-cf94fd" not found

openshift-ingress

multus

payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

ProbeError

Startup probe error: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

Unhealthy

Startup probe failed: Get "http://10.132.0.95:15021/healthz/ready": dial tcp 10.132.0.95:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-a954c8-746bbd8478-h772s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-a954c8-5789fbd795-kb4dg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-a954c8

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-a954c8: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-a954c8": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-a954c8, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 011adf1e-5308-4b0d-aa98-5f05cbe66a36, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-a954c8-openshift-default-6d4655bc96-rkjgv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf94fd-6df5bf4d77-gsg47

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf94fd-7bd4cc67d-h5w94

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-cf94fd-openshift-default-545595cdc4-j9vhb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-c98839-674d6646c8-2rpwq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-c98839-6d5b54bc9c-d5h5d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-1269b2-8455c6cfbb-62rzs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-1269b2-fdd4895d7-mr8fh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-c98839-openshift-default-5b7649b5b6-64r5x

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-1269b2-openshift-default-7d5fd5748d-ss8md

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-b83f70-5c89b74c7f-wss9m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-b83f70-76b45865f4-cqtjg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-b83f70-openshift-default-76b65b48fb-xclmr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-fcd9f3-7ddd896b5-g9c2p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-fcd9f3-75484f6654-8cpcf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-fcd9f3-openshift-default-d4fcdc8f4-zlqx6

Killing

Stopping container istio-proxy

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-cc3801-7d57f99f8-tls99

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-cc3801-5dd77656bc-ggnzs

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-cc3801-openshift-default-56c68b8d4d-82qfr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4c29a2-6c899b8d54-pqx9d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4c29a2-67ddf688bc-c9g6v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-4c29a2-openshift-default-c898b8b7b-2fgcd

Killing

Stopping container istio-proxy