Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45 to ip-10-0-134-191.ec2.internal

openshift-ingress

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz to ip-10-0-134-191.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

Scheduled

Successfully assigned openshift-ingress/e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2 to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4 to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

Scheduled

Successfully assigned openshift-ingress/e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-44m7q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-44m7q to ip-10-0-134-191.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-c8789319-openshift-default-7bfc489944-spgfv to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c to ip-10-0-134-191.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8 to ip-10-0-134-191.ec2.internal

openshift-ingress

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf to ip-10-0-134-191.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4 to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw to ip-10-0-128-161.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-r4fsw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-r4fsw to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z to ip-10-0-128-161.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-qxgqr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-qxgqr to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw to ip-10-0-134-191.ec2.internal

openshift-ingress

payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627 to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

Scheduled

Successfully assigned openshift-ingress/e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6 to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px to ip-10-0-138-44.ec2.internal

openshift-ingress

kube-auth-proxy-7c75bd8f97-b9d4w

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c75bd8f97-b9d4w to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8 to ip-10-0-128-161.ec2.internal

openshift-ingress

router-default-c8fff6cd4-tr742

Scheduled

Successfully assigned openshift-ingress/router-default-c8fff6cd4-tr742 to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-6cdvp

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-6cdvp to ip-10-0-138-44.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-vdztn

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vdztn to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8 to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8 to ip-10-0-138-44.ec2.internal

openshift-ingress

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

Scheduled

Successfully assigned openshift-ingress/e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8 to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-451902-7fc87746df-cvv8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-451902-7fc87746df-cvv8t to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2 to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk to ip-10-0-128-161.ec2.internal

openshift-ingress

kube-auth-proxy-7c75bd8f97-csrr2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7c75bd8f97-csrr2 to ip-10-0-128-161.ec2.internal

openshift-ingress

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn to ip-10-0-134-191.ec2.internal

openshift-ingress

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c to ip-10-0-138-44.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4 to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm to ip-10-0-134-191.ec2.internal

openshift-ingress

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

Scheduled

Successfully assigned openshift-ingress/e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx to ip-10-0-128-161.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx to ip-10-0-138-44.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-c8fff6cd4 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-c8fff6cd4

FailedCreate

Error creating: pods "router-default-c8fff6cd4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-c8fff6cd4

FailedCreate

Error creating: pods "router-default-c8fff6cd4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-c8fff6cd4

SuccessfulCreate

Created pod: router-default-c8fff6cd4-tr742
(x5)

openshift-ingress

kubelet

router-default-c8fff6cd4-tr742

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-c8fff6cd4-tr742

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-c8fff6cd4-tr742

Started

Started container router

openshift-ingress

kubelet

router-default-c8fff6cd4-tr742

Created

Created container: router

openshift-ingress

multus

router-default-c8fff6cd4-tr742

AddedInterface

Add eth0 [10.132.0.15/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-c8fff6cd4-tr742

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-7c75bd8f97

SuccessfulCreate

Created pod: kube-auth-proxy-7c75bd8f97-b9d4w

openshift-ingress

replicaset-controller

kube-auth-proxy-7c75bd8f97

SuccessfulCreate

Created pod: kube-auth-proxy-7c75bd8f97-csrr2
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7c75bd8f97

FailedCreate

Error creating: pods "kube-auth-proxy-7c75bd8f97-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7c75bd8f97 from 0 to 2

openshift-ingress

multus

kube-auth-proxy-7c75bd8f97-csrr2

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-csrr2

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-b9d4w

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7c75bd8f97-b9d4w

AddedInterface

Add eth0 [10.134.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-b9d4w

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4fsw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-r4fsw

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-csrr2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-r4fsw

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-csrr2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-csrr2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-csrr2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.728s (2.728s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-b9d4w

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-b9d4w

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7c75bd8f97-b9d4w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.609s (2.609s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4fsw

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4fsw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4fsw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.568s (3.568s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.719s (2.719s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-zz8lz

Started

Started container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-qxgqr

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-qxgqr

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qxgqr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qxgqr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qxgqr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.541s (2.541s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qxgqr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qxgqr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qxgqr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-r4fsw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-r4fsw

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-vdztn

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-vdztn

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-44m7q

openshift-ingress

multus

payload-processing-5b54b7fbb7-6cdvp

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6cdvp

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-44m7q

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-44m7q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-6cdvp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6cdvp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.477s (1.477s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6cdvp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6cdvp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-44m7q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-44m7q

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-44m7q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.495s (2.495s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vdztn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vdztn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vdztn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vdztn

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vdztn

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-worker-w0-12fb6b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-12fb6b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-12fb6b

openshift-ingress

replicaset-controller

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494

SuccessfulCreate

Created pod: e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-06ef79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-06ef79

openshift-ingress

gateway_labeler_controller

e2e-inf-a-92d8ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-92d8ce

openshift-ingress

multus

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4

SuccessfulCreate

Created pod: e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

openshift-ingress

deployment-controller

e2e-worker-w4-06ef79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4 from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-92d8ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-92d8ce-openshift-default-5ff8db57b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8

SuccessfulCreate

Created pod: e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

openshift-ingress

multus

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-12fb6b: serviceaccount "payload-processing-e2e-worker-w0-12fb6b" not found

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-12fb6b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-12fb6b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-12fb6b: serviceaccount "payload-processing-e2e-worker-w0-12fb6b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-92d8ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-92d8ce-58865c97ff from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-92d8ce-58865c97ff

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-92d8ce-58865c97ff

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-92d8ce-58865c97ff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-92d8ce: serviceaccount "payload-processing-e2e-inf-a-92d8ce" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-92d8ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-92d8ce-6db769d994 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-92d8ce: serviceaccount "payload-processing-e2e-inf-a-92d8ce" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-autores-0a7a66-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-0a7a66-openshift-default-57c46f5964 from 0 to 1

openshift-ingress

multus

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-a0c7930e-openshift-default-865d96c648

SuccessfulCreate

Created pod: e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

openshift-ingress

deployment-controller

e2e-ait-a0c7930e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-a0c7930e-openshift-default-865d96c648 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-a0c7930e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-a0c7930e

openshift-ingress

gateway_labeler_controller

e2e-autores-0a7a66

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-0a7a66

openshift-ingress

replicaset-controller

e2e-autores-0a7a66-openshift-default-57c46f5964

SuccessfulCreate

Created pod: e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

openshift-ingress

multus

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0a7a66-69d5685995

FailedCreate

Error creating: pods "payload-processing-e2e-autores-0a7a66-69d5685995-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0a7a66: serviceaccount "payload-processing-e2e-autores-0a7a66" not found

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 13.25s (13.25s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-0a7a66

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-0a7a66

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-0a7a66-69d5685995 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-0a7a66: serviceaccount "payload-processing-e2e-autores-0a7a66" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-0a7a66-69d5685995

SuccessfulCreate

Created pod: payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a0c7930e: serviceaccount "payload-processing-e2e-ait-a0c7930e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-a0c7930e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a0c7930e-7bdcd6df79

FailedCreate

Error creating: pods "payload-processing-e2e-ait-a0c7930e-7bdcd6df79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-a0c7930e: serviceaccount "payload-processing-e2e-ait-a0c7930e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-a0c7930e-7bdcd6df79

SuccessfulCreate

Created pod: payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

openshift-ingress

deployment-controller

payload-processing-e2e-ait-a0c7930e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-a0c7930e-7bdcd6df79 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-06ef79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-06ef79-6886bf78c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-06ef79-6886bf78c7

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-06ef79-6886bf78c7

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-06ef79-6886bf78c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-06ef79: serviceaccount "payload-processing-e2e-worker-w4-06ef79" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-06ef79: serviceaccount "payload-processing-e2e-worker-w4-06ef79" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-06ef79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.575s (1.575s including waiting). Image size: 166449312 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-inf-b-bfa694

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-bfa694
(x2)

openshift-ingress

kubelet

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

e2e-inf-b-bfa694-openshift-default-6c9f8d96d

SuccessfulCreate

Created pod: e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

openshift-ingress

deployment-controller

e2e-inf-b-bfa694-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-bfa694-openshift-default-6c9f8d96d from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

Started

Started container istio-proxy

openshift-ingress

multus

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bfa694-6948794495

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-bfa694-6948794495

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-bfa694-6948794495-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bfa694: serviceaccount "payload-processing-e2e-inf-b-bfa694" not found
(x6)

openshift-ingress

kubelet

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

ProbeError

Startup probe error: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-bfa694

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-bfa694-6948794495 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-bfa694

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-bfa694-7679c8678b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-bfa694: serviceaccount "payload-processing-e2e-inf-b-bfa694" not found

openshift-ingress

multus

payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Unhealthy

Startup probe failed: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-a0c7930e-86d7fdb574-7pjk2

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

ProbeError

Startup probe error: Get "http://10.133.0.41:15021/healthz/ready": dial tcp 10.133.0.41:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-ait-a0c7930e-openshift-default-dockercfg-dxsdw); attempting to pull the image may not succeed.

openshift-ingress

kubelet

payload-processing-e2e-ait-a0c7930e-7bdcd6df79-596hf

Killing

Stopping container payload-processing
(x3)

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-migrate-7283a095-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-7283a095-gw

openshift-ingress

replicaset-controller

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4

SuccessfulCreate

Created pod: e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

openshift-ingress

deployment-controller

e2e-migrate-7283a095-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-7283a095-gw-openshift-default-68b7778dd4 from 0 to 1

openshift-ingress

kubelet

e2e-ait-a0c7930e-openshift-default-865d96c648-r2kng

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:

openshift-ingress

multus

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-7283a095

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-7283a095-597bb8b67d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-7283a095

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-7283a095-68d4db5698 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7283a095-597bb8b67d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-7283a095-597bb8b67d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-7283a095-597bb8b67d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7283a095: serviceaccount "payload-processing-e2e-migrate-7283a095" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7283a095-68d4db5698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-7283a095-68d4db5698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-7283a095: serviceaccount "payload-processing-e2e-migrate-7283a095" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-7283a095-68d4db5698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2
(x2)

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Unhealthy

Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

ProbeError

Startup probe error: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Unhealthy

Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

ProbeError

Startup probe error: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-7283a095-597bb8b67d-vwlxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-7283a095-68d4db5698-cm9l2

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-c8789319

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-c8789319

openshift-ingress

replicaset-controller

e2e-ait-c8789319-openshift-default-7bfc489944

SuccessfulCreate

Created pod: e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

openshift-ingress

deployment-controller

e2e-ait-c8789319-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-c8789319-openshift-default-7bfc489944 from 0 to 1

openshift-ingress

multus

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-migrate-7283a095-gw-openshift-default-68b7778dd4-7cqql

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c8789319-6fb7cddbc5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-c8789319-6fb7cddbc5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-c8789319-6fb7cddbc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c8789319: serviceaccount "payload-processing-e2e-ait-c8789319" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-c8789319

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-c8789319-6fb7cddbc5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-c8789319

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-c8789319-584cb46778 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c8789319-584cb46778

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-c8789319-584cb46778

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-c8789319-584cb46778-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-c8789319: serviceaccount "payload-processing-e2e-ait-c8789319" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-c8789319-6fb7cddbc5-zc627

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-c8789319-584cb46778-nr6bm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-c8789319-openshift-default-7bfc489944-spgfv

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-derive-7e6fa6af-openshift-default-5587bc9748

SuccessfulCreate

Created pod: e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

openshift-ingress

deployment-controller

e2e-derive-7e6fa6af-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-7e6fa6af-openshift-default-5587bc9748 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-7e6fa6af

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-7e6fa6af

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7e6fa6af: serviceaccount "payload-processing-e2e-derive-7e6fa6af" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-7e6fa6af: serviceaccount "payload-processing-e2e-derive-7e6fa6af" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

openshift-ingress

deployment-controller

payload-processing-e2e-derive-7e6fa6af

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-7e6fa6af

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-0a7a66-69d5685995-bg6rm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-0a7a66-6f77b7d5b6-xbxqf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-7e6fa6af-7d47cb5fd-mf45c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-7e6fa6af-dc5ff4fdf-gmb8c

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-7e6fa6af-openshift-default-5587bc9748-srqxx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-0a7a66-openshift-default-57c46f5964-j4wm8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-7719ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7719ed

openshift-ingress

replicaset-controller

e2e-explicit-7719ed-openshift-default-7cf684688d

SuccessfulCreate

Created pod: e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

openshift-ingress

deployment-controller

e2e-explicit-7719ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7719ed-openshift-default-7cf684688d from 0 to 1

openshift-ingress

multus

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7719ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7719ed-65dd8b78bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7719ed-65dd8b78bf

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7719ed-65dd8b78bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7719ed: serviceaccount "payload-processing-e2e-explicit-7719ed" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7719ed: serviceaccount "payload-processing-e2e-explicit-7719ed" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7719ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7719ed-65dd8b78bf

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

openshift-ingress

kubelet

payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-1ebfb31f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-1ebfb31f

openshift-ingress

deployment-controller

e2e-mt-1ebfb31f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-1ebfb31f-openshift-default-5fb66f6676 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-1ebfb31f-openshift-default-5fb66f6676

SuccessfulCreate

Created pod: e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

openshift-ingress

multus

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-1ebfb31f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-1ebfb31f-764b8d6c8f from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1ebfb31f: serviceaccount "payload-processing-e2e-mt-1ebfb31f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-1ebfb31f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f

FailedCreate

Error creating: pods "payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-1ebfb31f: serviceaccount "payload-processing-e2e-mt-1ebfb31f" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f

SuccessfulCreate

Created pod: payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn
(x2)

openshift-ingress

kubelet

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-7719ed-65dd8b78bf-8nrmd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7719ed-56dcdfbd4b-7929v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-1ebfb31f-6747d7d554-m2vvn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-1ebfb31f-764b8d6c8f-7tshx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-1ebfb31f-openshift-default-5fb66f6676-wpbr6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-7719ed-openshift-default-7cf684688d-bjzms

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-c0d4bf-openshift-default-948f987d

SuccessfulCreate

Created pod: e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

openshift-ingress

gateway_labeler_controller

e2e-noten-c0d4bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-c0d4bf

openshift-ingress

deployment-controller

e2e-noten-c0d4bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-c0d4bf-openshift-default-948f987d from 0 to 1

openshift-ingress

kubelet

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58

SuccessfulCreate

Created pod: e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

openshift-ingress

deployment-controller

e2e-shared-a-w2-cd48eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-cd48eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-cd48eb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cd48eb: serviceaccount "payload-processing-e2e-shared-a-w2-cd48eb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cd48eb: serviceaccount "payload-processing-e2e-shared-a-w2-cd48eb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-cd48eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-cd48eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-97d9dc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68

SuccessfulCreate

Created pod: e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

openshift-ingress

multus

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-97d9dc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-97d9dc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-97d9dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-97d9dc: serviceaccount "payload-processing-e2e-shared-b-w2-97d9dc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-97d9dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-97d9dc-85575b58c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-97d9dc: serviceaccount "payload-processing-e2e-shared-b-w2-97d9dc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-b96fb0e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b96fb0e1-openshift-default-df6bbcc4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-b96fb0e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b96fb0e1

openshift-ingress

replicaset-controller

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d

SuccessfulCreate

Created pod: e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

openshift-ingress

multus

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b96fb0e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b96fb0e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b96fb0e1-5ccd848db5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b96fb0e1-5ccd848db5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b96fb0e1-5ccd848db5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b96fb0e1: serviceaccount "payload-processing-e2e-mt-b96fb0e1" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-92d8ce-6db769d994-xsnnb

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b96fb0e1-5ccd848db5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b96fb0e1: serviceaccount "payload-processing-e2e-mt-b96fb0e1" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-92d8ce-58865c97ff-vl8t8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-92d8ce-openshift-default-5ff8db57b8-8xvzw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-bfa694-7679c8678b-zzpqs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-bfa694-6948794495-k9f5t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-c0d4bf-openshift-default-948f987d-4kbcq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6

SuccessfulCreate

Created pod: e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

openshift-ingress

multus

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w3-1c4628-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1c4628-openshift-default-85667b69c6 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1c4628

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1c4628

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-bfa694-openshift-default-6c9f8d96d-7mmsq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1c4628

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1c4628: serviceaccount "payload-processing-e2e-shared-a-w3-1c4628" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1c4628: serviceaccount "payload-processing-e2e-shared-a-w3-1c4628" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1c4628

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-da9451

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-da9451

openshift-ingress

replicaset-controller

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8

SuccessfulCreate

Created pod: e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

openshift-ingress

deployment-controller

e2e-shared-b-w3-da9451-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-da9451: serviceaccount "payload-processing-e2e-shared-b-w3-da9451" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-da9451

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-da9451

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-da9451: serviceaccount "payload-processing-e2e-shared-b-w3-da9451" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

ProbeError

Startup probe error: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

Unhealthy

Startup probe failed: Get "http://10.132.0.77:15021/healthz/ready": dial tcp 10.132.0.77:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-b96fb0e1-5ccd848db5-pj5s2

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-b96fb0e1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-b96fb0e1: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-b96fb0e1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-b96fb0e1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 35644b3d-b73d-48b3-bb90-b895867a4990, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b96fb0e1-74dd49cb7d-wgkmn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-b96fb0e1-openshift-default-df6bbcc4d-shm4v

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-451902-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-451902-openshift-default-c6cc6d66b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-451902-openshift-default-c6cc6d66b

SuccessfulCreate

Created pod: e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

openshift-ingress

gateway_labeler_controller

e2e-api-a-451902

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-451902

openshift-ingress

multus

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-451902-7fc87746df

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-451902-7fc87746df-cvv8t
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-451902: serviceaccount "payload-processing-e2e-api-a-451902" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-451902

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-451902-d8d4b8fdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-451902

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-451902-7fc87746df from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-451902-7fc87746df

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-451902-7fc87746df-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-451902: serviceaccount "payload-processing-e2e-api-a-451902" not found

openshift-ingress

multus

payload-processing-e2e-api-a-451902-7fc87746df-cvv8t

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-451902-7fc87746df-cvv8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-451902-7fc87746df-cvv8t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-451902-7fc87746df-cvv8t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Unhealthy

Readiness probe failed: Get "http://10.132.0.85:15021/healthz/ready": read tcp 10.132.0.2:41738->10.132.0.85:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

ProbeError

Readiness probe error: Get "http://10.132.0.85:15021/healthz/ready": read tcp 10.132.0.2:41738->10.132.0.85:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-api-b-d1b012

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-d1b012
(x2)

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-d1b012-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-d1b012-openshift-default-7db67f95bb from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-d1b012-openshift-default-7db67f95bb

SuccessfulCreate

Created pod: e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

openshift-ingress

multus

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Unhealthy

Startup probe failed: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

ProbeError

Startup probe error: Get "http://10.132.0.85:15021/healthz/ready": dial tcp 10.132.0.85:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-d1b012

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-d1b012-795cfd6c6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d1b012-795cfd6c6f

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-d1b012-795cfd6c6f

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-d1b012-795cfd6c6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d1b012: serviceaccount "payload-processing-e2e-api-b-d1b012" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d1b012-59676779d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-d1b012-59676779d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-d1b012: serviceaccount "payload-processing-e2e-api-b-d1b012" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-d1b012-59676779d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-d1b012

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-d1b012-59676779d6 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2

AddedInterface

Add eth0 [10.134.0.79/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-worker-w0-12fb6b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-worker-w0-12fb6b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-worker-w0-12fb6b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-worker-w0-12fb6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 85bc63b7-a062-4f9c-b68d-7db42e914952, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-12fb6b-766f84b78-776d8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-12fb6b-5ff4c775b5-kbtz8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-12fb6b-openshift-default-6b9b8c9494-xrbgp

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-451902

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-451902: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-451902": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-451902, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: aba9c0a5-1378-4f01-893e-4123b5f5e0f0, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-451902-d8d4b8fdb-pwgs4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-451902-7fc87746df-cvv8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-451902-openshift-default-c6cc6d66b-b5hbw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Unhealthy

Readiness probe failed: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

ProbeError

Readiness probe error: Get "http://10.132.0.88:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-d1b012-59676779d6-48drk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-d1b012-795cfd6c6f-q58q2

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

ProbeError

Startup probe error: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Unhealthy

Startup probe failed: Get "http://10.132.0.88:15021/healthz/ready": dial tcp 10.132.0.88:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-api-b-d1b012-openshift-default-dockercfg-dbjhc); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-api-b-d1b012-openshift-default-7db67f95bb-tslk8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cd48eb-6dc9cf949d-zrwqx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cd48eb-56659ccdf-nj9f4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-cd48eb-openshift-default-76cd487f58-fm5sq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-97d9dc-56cd4d986b-fx5n6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-97d9dc-85575b58c-sn89x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-06ef79-6886bf78c7-pn252

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-06ef79-77bfb74cfd-5mr6z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-97d9dc-openshift-default-7bfd65cf68-sltcx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-worker-w4-06ef79-openshift-default-5d9c8f65c4-t2pgw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-1fb90b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-1fb90b

openshift-ingress

replicaset-controller

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d

SuccessfulCreate

Created pod: e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

openshift-ingress

deployment-controller

e2e-ipp-a-1fb90b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d from 0 to 1

openshift-ingress

multus

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

AddedInterface

Add eth0 [10.132.0.96/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1fb90b: serviceaccount "payload-processing-e2e-ipp-a-1fb90b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-1fb90b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-1fb90b-cfbb678c7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-1fb90b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-1fb90b: serviceaccount "payload-processing-e2e-ipp-a-1fb90b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Unhealthy

Readiness probe failed: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

ProbeError

Readiness probe error: Get "http://10.132.0.96:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Unhealthy

Startup probe failed: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

ProbeError

Startup probe error: Get "http://10.132.0.96:15021/healthz/ready": dial tcp 10.132.0.96:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-778566

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-778566

openshift-ingress

multus

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

AddedInterface

Add eth0 [10.132.0.97/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-778566-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-778566-openshift-default-5f49f5c898 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-778566-openshift-default-5f49f5c898

SuccessfulCreate

Created pod: e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-778566

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-778566-58bc558dbb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-778566

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-778566-5cf5df78d5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-778566-5cf5df78d5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-778566-5cf5df78d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-778566: serviceaccount "payload-processing-e2e-ipp-b-778566" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-778566-5cf5df78d5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-778566: serviceaccount "payload-processing-e2e-ipp-b-778566" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

openshift-ingress

multus

payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

Unhealthy

Startup probe failed: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

ProbeError

Startup probe error: Get "http://10.132.0.97:15021/healthz/ready": dial tcp 10.132.0.97:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-e231ef-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-e231ef

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-e231ef

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44

SuccessfulCreate

Created pod: e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

openshift-ingress

multus

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

AddedInterface

Add eth0 [10.132.0.99/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-e231ef

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-e231ef-845c747955 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e231ef: serviceaccount "payload-processing-e2e-ipp-cleanup-e231ef" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e231ef-845c747955

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-e231ef-845c747955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-e231ef: serviceaccount "payload-processing-e2e-ipp-cleanup-e231ef" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-e231ef

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-e231ef-845c747955

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

Unhealthy

Startup probe failed: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

ProbeError

Startup probe error: Get "http://10.132.0.99:15021/healthz/ready": dial tcp 10.132.0.99:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-e231ef-6cb86f4574-t8hjv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-e231ef-845c747955-qjnr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-e231ef-openshift-default-77d77f5c44-bfvjr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-1fb90b-cfbb678c7-mxtv4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-1fb90b-6cf74c8986-pmg45

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-1fb90b-openshift-default-5749d8ff7d-kt4cl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-778566-5cf5df78d5-2c2qz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-778566-58bc558dbb-7mfnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-778566-openshift-default-5f49f5c898-cjpxf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1c4628-6d4478c59d-tfs2w

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1c4628-75dbdcf85f-n86px

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-1c4628-openshift-default-85667b69c6-zw75k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-da9451-6c58f4fd45-5j2rc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-da9451-68db85ddf4-n6gb9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-da9451-openshift-default-756d5c4ff8-k5htw

Killing

Stopping container istio-proxy