Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts to ip-10-0-136-151.ec2.internal

openshift-ingress

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv to ip-10-0-136-151.ec2.internal

openshift-ingress

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm to ip-10-0-136-151.ec2.internal

openshift-ingress

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

Scheduled

Successfully assigned openshift-ingress/e2e-noten-40d65f-openshift-default-78479bb66-jrwpd to ip-10-0-136-151.ec2.internal

openshift-ingress

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Scheduled

Successfully assigned openshift-ingress/e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-derive-f68becc7-645886497-2htnv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-f68becc7-645886497-2htnv to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6 to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-ait-0827ee43-78c485b659-chws5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-0827ee43-78c485b659-chws5 to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2 to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-6fs7j

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-6fs7j to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7 to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4 to ip-10-0-135-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw to ip-10-0-135-61.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4 to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn to ip-10-0-136-151.ec2.internal

openshift-ingress

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

Scheduled

Successfully assigned openshift-ingress/e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

Scheduled

Successfully assigned openshift-ingress/e2e-mt-766d8c20-openshift-default-69f5999856-sk499 to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c to ip-10-0-136-151.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jbrvm to ip-10-0-135-116.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-hmj8k

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hmj8k to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69 to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm to ip-10-0-135-116.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-j4c88

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-j4c88 to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz to ip-10-0-135-116.ec2.internal

openshift-ingress

kube-auth-proxy-767744946f-t79lq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-767744946f-t79lq to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf to ip-10-0-135-61.ec2.internal

openshift-ingress

kube-auth-proxy-767744946f-qhd87

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-767744946f-qhd87 to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg to ip-10-0-135-116.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-044266-openshift-default-95fddb794-86m9l to ip-10-0-136-151.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-2krmt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-2krmt to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8 to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-636944-58b969c559-52glp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-636944-58b969c559-52glp to ip-10-0-136-151.ec2.internal

openshift-ingress

router-default-84d6cf958b-xf674

Scheduled

Successfully assigned openshift-ingress/router-default-84d6cf958b-xf674 to ip-10-0-136-151.ec2.internal

openshift-ingress

router-default-84d6cf958b-xf674

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj to ip-10-0-135-116.ec2.internal

openshift-ingress

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9 to ip-10-0-136-151.ec2.internal

openshift-ingress

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78 to ip-10-0-135-116.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll to ip-10-0-135-61.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b to ip-10-0-136-151.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn to ip-10-0-135-61.ec2.internal

openshift-ingress

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Scheduled

Successfully assigned openshift-ingress/e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l to ip-10-0-136-151.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-84d6cf958b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-84d6cf958b

FailedCreate

Error creating: pods "router-default-84d6cf958b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-84d6cf958b

FailedCreate

Error creating: pods "router-default-84d6cf958b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-84d6cf958b

SuccessfulCreate

Created pod: router-default-84d6cf958b-xf674
(x6)

openshift-ingress

kubelet

router-default-84d6cf958b-xf674

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-84d6cf958b-xf674

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-84d6cf958b-xf674

Started

Started container router

openshift-ingress

kubelet

router-default-84d6cf958b-xf674

Created

Created container: router

openshift-ingress

kubelet

router-default-84d6cf958b-xf674

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-84d6cf958b-xf674

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-767744946f-t79lq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-767744946f-qhd87

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

multus

kube-auth-proxy-767744946f-t79lq

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-767744946f

SuccessfulCreate

Created pod: kube-auth-proxy-767744946f-qhd87

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-767744946f from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-767744946f

SuccessfulCreate

Created pod: kube-auth-proxy-767744946f-t79lq

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-767744946f-qhd87

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-767744946f-qhd87

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-hmj8k

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-hmj8k

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-767744946f-qhd87

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.49s (2.49s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-767744946f-qhd87

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-767744946f-t79lq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.79s (3.79s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-767744946f-t79lq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-767744946f-t79lq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-767744946f-qhd87

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.75s (3.75s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.832s (2.832s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-qzdlg

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-2krmt

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-2krmt

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2krmt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2krmt

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2krmt

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-2krmt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.437s (2.437s including waiting). Image size: 181126104 bytes.

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-hmj8k

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-hmj8k

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-jbrvm

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.422s (2.422s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6fs7j

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-6fs7j

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-j4c88

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j4c88

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-j4c88

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-6fs7j
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6fs7j

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.818s (1.818s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6fs7j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-6fs7j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j4c88

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j4c88

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.205s (3.205s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j4c88

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-jbrvm

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-a41a24-openshift-default-55c96fbfb8

SuccessfulCreate

Created pod: e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

openshift-ingress

gateway_labeler_controller

e2e-inf-a-a41a24

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-a41a24

openshift-ingress

multus

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-a-a41a24-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-a41a24-openshift-default-55c96fbfb8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-a41a24

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-a41a24-7db5d59799 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a41a24: serviceaccount "payload-processing-e2e-inf-a-a41a24" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a41a24-7db5d59799

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-a41a24-7db5d59799

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-a41a24-7db5d59799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-a41a24: serviceaccount "payload-processing-e2e-inf-a-a41a24" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-a41a24

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-0827ee43-openshift-default-5b49f4d5c6

SuccessfulCreate

Created pod: e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

openshift-ingress

deployment-controller

e2e-ait-0827ee43-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-0827ee43-openshift-default-5b49f4d5c6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-0827ee43

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-0827ee43

openshift-ingress

replicaset-controller

e2e-autores-94604f-openshift-default-5d9b6fdd88

SuccessfulCreate

Created pod: e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

openshift-ingress

multus

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-94604f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-94604f-openshift-default-5d9b6fdd88 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-94604f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-94604f

openshift-ingress

multus

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0827ee43-78c485b659

FailedCreate

Error creating: pods "payload-processing-e2e-ait-0827ee43-78c485b659-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0827ee43: serviceaccount "payload-processing-e2e-ait-0827ee43" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-0827ee43

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-0827ee43: serviceaccount "payload-processing-e2e-ait-0827ee43" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-0827ee43

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-0827ee43-78c485b659 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-94604f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-94604f-59b4cbff67 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-94604f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-94604f-5848d7c4cd from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

openshift-ingress

multus

payload-processing-e2e-ait-0827ee43-78c485b659-chws5

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0827ee43-78c485b659-chws5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-0827ee43-78c485b659-chws5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0827ee43-78c485b659-chws5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-0827ee43-78c485b659

SuccessfulCreate

Created pod: payload-processing-e2e-ait-0827ee43-78c485b659-chws5

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-94604f-5848d7c4cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-94604f-59b4cbff67

SuccessfulCreate

Created pod: payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-94604f-59b4cbff67

FailedCreate

Error creating: pods "payload-processing-e2e-autores-94604f-59b4cbff67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-94604f: serviceaccount "payload-processing-e2e-autores-94604f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-94604f-5848d7c4cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-94604f-5848d7c4cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-94604f: serviceaccount "payload-processing-e2e-autores-94604f" not found

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

ProbeError

Readiness probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Unhealthy

Readiness probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-69dcc8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-69dcc8

openshift-ingress

deployment-controller

e2e-inf-b-69dcc8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-69dcc8-openshift-default-6648544794 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-69dcc8-openshift-default-6648544794

SuccessfulCreate

Created pod: e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

openshift-ingress

multus

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-69dcc8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-69dcc8: serviceaccount "payload-processing-e2e-inf-b-69dcc8" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-69dcc8-f54447965

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-69dcc8-f54447965-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-69dcc8: serviceaccount "payload-processing-e2e-inf-b-69dcc8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-69dcc8-f54447965

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-69dcc8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-69dcc8-f54447965 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.74s (2.74s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

Started

Started container payload-pre-processing
(x6)

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-0827ee43-78b67bfd6b-tlmkf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-0827ee43-78c485b659-chws5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-0827ee43-openshift-default-5b49f4d5c6-nlzwz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-migrate-c2ec79e5-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c2ec79e5-gw

openshift-ingress

multus

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-c2ec79e5-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988

SuccessfulCreate

Created pod: e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69
(x6)

openshift-ingress

kubelet

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

Unhealthy

Startup probe failed: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

ProbeError

Startup probe error: Get "http://10.134.0.50:15021/healthz/ready": dial tcp 10.134.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c2ec79e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c2ec79e5-79db788686 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c2ec79e5-79db788686

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c2ec79e5-79db788686

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c2ec79e5-79db788686-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c2ec79e5: serviceaccount "payload-processing-e2e-migrate-c2ec79e5" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c2ec79e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c2ec79e5: serviceaccount "payload-processing-e2e-migrate-c2ec79e5" not found
(x2)

openshift-ingress

kubelet

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

ProbeError

Startup probe error: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

Unhealthy

Startup probe failed: Get "http://10.132.0.50:15021/healthz/ready": dial tcp 10.132.0.50:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-c2ec79e5-gw-openshift-default-5cfcb8d988-c7j69

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-c2ec79e5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-c2ec79e5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-c2ec79e5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 22cddb41-e355-4456-9531-f47a59a54144, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c2ec79e5-86876b859d-dz8zk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c2ec79e5-79db788686-t7j2v

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-1992fc41

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-1992fc41

openshift-ingress

deployment-controller

e2e-ait-1992fc41-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-1992fc41-openshift-default-695fcc84fd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-1992fc41-openshift-default-695fcc84fd

SuccessfulCreate

Created pod: e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

openshift-ingress

multus

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1992fc41-799969bc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-1992fc41-799969bc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-1992fc41-799969bc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1992fc41: serviceaccount "payload-processing-e2e-ait-1992fc41" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-1992fc41

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-1992fc41-799969bc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1992fc41-84fcc767bf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-1992fc41-84fcc767bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-1992fc41: serviceaccount "payload-processing-e2e-ait-1992fc41" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-1992fc41-84fcc767bf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-1992fc41

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-1992fc41-84fcc767bf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-94604f-59b4cbff67-x9wtp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-94604f-5848d7c4cd-knqfp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-50ba47

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-50ba47

openshift-ingress

deployment-controller

e2e-explicit-50ba47-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-50ba47-openshift-default-788cfccd9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-50ba47-openshift-default-788cfccd9b

SuccessfulCreate

Created pod: e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

openshift-ingress

multus

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-94604f-openshift-default-5d9b6fdd88-qh7k9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-50ba47

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-50ba47-768dbcf6f7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-50ba47

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-50ba47-554c4f7698 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-50ba47-768dbcf6f7

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-50ba47-768dbcf6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-50ba47: serviceaccount "payload-processing-e2e-explicit-50ba47" not found
(x2)

openshift-ingress

kubelet

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

Created

Created container: istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-50ba47-554c4f7698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-50ba47-554c4f7698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-50ba47: serviceaccount "payload-processing-e2e-explicit-50ba47" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-50ba47-554c4f7698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

openshift-ingress

multus

payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-50ba47-768dbcf6f7

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-1992fc41-799969bc4-hhs6b

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-1992fc41-84fcc767bf-sd9xm

Killing

Stopping container payload-processing
(x7)

openshift-ingress

kubelet

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

Killing

Stopping container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-ait-1992fc41-openshift-default-695fcc84fd-5b94j

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-derive-f68becc7-openshift-default-cb797594d

SuccessfulCreate

Created pod: e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

openshift-ingress

deployment-controller

e2e-derive-f68becc7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-f68becc7-openshift-default-cb797594d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-f68becc7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-f68becc7

openshift-ingress

multus

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-f68becc7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-f68becc7-c8b887bcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-f68becc7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-f68becc7-645886497 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f68becc7: serviceaccount "payload-processing-e2e-derive-f68becc7" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f68becc7-645886497

FailedCreate

Error creating: pods "payload-processing-e2e-derive-f68becc7-645886497-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-f68becc7: serviceaccount "payload-processing-e2e-derive-f68becc7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-f68becc7-645886497-2htnv

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-f68becc7-645886497-2htnv

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-f68becc7-645886497

SuccessfulCreate

Created pod: payload-processing-e2e-derive-f68becc7-645886497-2htnv

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-f68becc7-645886497-2htnv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

openshift-ingress

kubelet

payload-processing-e2e-derive-f68becc7-645886497-2htnv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

ProbeError

Startup probe error: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Unhealthy

Startup probe failed: Get "http://10.134.0.54:15021/healthz/ready": dial tcp 10.134.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Unhealthy

Readiness probe failed: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

ProbeError

Readiness probe error: Get "http://10.132.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

ProbeError

Startup probe error: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Unhealthy

Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-derive-f68becc7-openshift-default-cb797594d-7xd2l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-f68becc7-645886497-2htnv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-f68becc7-c8b887bcd-f2zmf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-50ba47-768dbcf6f7-227v7

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-50ba47

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-50ba47: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-50ba47": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-50ba47, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 469660b3-ef5b-4982-8e0f-b237bc260669, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-50ba47-554c4f7698-tbwst

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-40d65f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-40d65f-openshift-default-78479bb66 from 0 to 1

openshift-ingress

kubelet

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-40d65f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-40d65f

openshift-ingress

multus

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-noten-40d65f-openshift-default-78479bb66

SuccessfulCreate

Created pod: e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

openshift-ingress

kubelet

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-50ba47-openshift-default-788cfccd9b-9pfbz

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-40d65f-openshift-default-78479bb66-jrwpd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-mt-766d8c20-openshift-default-69f5999856

SuccessfulCreate

Created pod: e2e-mt-766d8c20-openshift-default-69f5999856-sk499

openshift-ingress

gateway_labeler_controller

e2e-mt-766d8c20

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-766d8c20

openshift-ingress

deployment-controller

e2e-mt-766d8c20-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-766d8c20-openshift-default-69f5999856 from 0 to 1

openshift-ingress

multus

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-766d8c20: serviceaccount "payload-processing-e2e-mt-766d8c20" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-766d8c20-7fb5bf5d9

SuccessfulCreate

Created pod: payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

openshift-ingress

deployment-controller

payload-processing-e2e-mt-766d8c20

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-766d8c20-7fb5bf5d9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-766d8c20-7fb5bf5d9

FailedCreate

Error creating: pods "payload-processing-e2e-mt-766d8c20-7fb5bf5d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-766d8c20: serviceaccount "payload-processing-e2e-mt-766d8c20" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-766d8c20

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-766d8c20-65c7b8749d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-a41a24-56659d7dfd-8dw8j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-a41a24-7db5d59799-5xbmq

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-a41a24-openshift-default-55c96fbfb8-454cj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-69dcc8-7784777b8b-7hzd6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-69dcc8-f54447965-9skgn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-766d8c20-7fb5bf5d9-7cgtv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-766d8c20-65c7b8749d-whn9c

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-766d8c20

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-766d8c20: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-766d8c20": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-766d8c20, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 4ee61e0a-1b24-4655-ba61-aa1823318a0e, UID in object meta:

openshift-ingress

kubelet

e2e-inf-b-69dcc8-openshift-default-6648544794-9cxsm

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-8623b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-8623b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-8623b2

openshift-ingress

replicaset-controller

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8

SuccessfulCreate

Created pod: e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

openshift-ingress

multus

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-766d8c20-openshift-default-69f5999856-sk499

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-8623b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8623b2: serviceaccount "payload-processing-e2e-shared-a-w3-8623b2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-8623b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-8623b2: serviceaccount "payload-processing-e2e-shared-a-w3-8623b2" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4

SuccessfulCreate

Created pod: e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

openshift-ingress

deployment-controller

e2e-shared-a-w2-91c25e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-91c25e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-91c25e
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

ProbeError

Readiness probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Unhealthy

Readiness probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-91c25e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-91c25e: serviceaccount "payload-processing-e2e-shared-a-w2-91c25e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-91c25e-df4454f99

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-91c25e-df4454f99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-91c25e: serviceaccount "payload-processing-e2e-shared-a-w2-91c25e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-91c25e-df4454f99

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-91c25e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-91c25e-df4454f99 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-4eb314

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-4eb314

openshift-ingress

replicaset-controller

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd

SuccessfulCreate

Created pod: e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

openshift-ingress

multus

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w3-4eb314-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": read tcp 10.132.0.2:47856->10.132.0.74:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-4eb314

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-4eb314-5776df85f9 from 0 to 1

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": read tcp 10.132.0.2:47856->10.132.0.74:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314: serviceaccount "payload-processing-e2e-shared-b-w3-4eb314" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-4eb314

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-4eb314: serviceaccount "payload-processing-e2e-shared-b-w3-4eb314" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w2-837e16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-837e16-openshift-default-6464f7596 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-837e16-openshift-default-6464f7596

SuccessfulCreate

Created pod: e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

openshift-ingress

multus

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-837e16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-837e16

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-837e16: serviceaccount "payload-processing-e2e-shared-b-w2-837e16" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-837e16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-837e16-659dff4b79

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-837e16-659dff4b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-837e16: serviceaccount "payload-processing-e2e-shared-b-w2-837e16" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-837e16-659dff4b79

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-837e16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-837e16-659dff4b79 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-8ba2d470-openshift-default-68fd568ffb

SuccessfulCreate

Created pod: e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

openshift-ingress

gateway_labeler_controller

e2e-mt-8ba2d470

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-8ba2d470

openshift-ingress

deployment-controller

e2e-mt-8ba2d470-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-8ba2d470-openshift-default-68fd568ffb from 0 to 1

openshift-ingress

multus

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-8ba2d470

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-8ba2d470-67579b8c78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

openshift-ingress

deployment-controller

payload-processing-e2e-mt-8ba2d470

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-8ba2d470-ddc66c59c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8ba2d470-ddc66c59c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-8ba2d470-ddc66c59c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-8ba2d470-ddc66c59c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8ba2d470: serviceaccount "payload-processing-e2e-mt-8ba2d470" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-8ba2d470: serviceaccount "payload-processing-e2e-mt-8ba2d470" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

ProbeError

Startup probe error: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

Unhealthy

Startup probe failed: Get "http://10.132.0.80:15021/healthz/ready": dial tcp 10.132.0.80:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-8ba2d470-67579b8c78-927th

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-8ba2d470-ddc66c59c-vrx7d

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-8ba2d470-openshift-default-68fd568ffb-2xhp2

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-3a1a62-openshift-default-6b7c5698bd

SuccessfulCreate

Created pod: e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

openshift-ingress

deployment-controller

e2e-api-a-3a1a62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-3a1a62-openshift-default-6b7c5698bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-3a1a62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-3a1a62

openshift-ingress

multus

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3a1a62-646854d7bc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3a1a62: serviceaccount "payload-processing-e2e-api-a-3a1a62" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-3a1a62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-3a1a62-646854d7bc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-3a1a62-646854d7bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-3a1a62: serviceaccount "payload-processing-e2e-api-a-3a1a62" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-3a1a62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-3a1a62-646854d7bc from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-044266-openshift-default-95fddb794

SuccessfulCreate

Created pod: e2e-api-b-044266-openshift-default-95fddb794-86m9l

openshift-ingress

gateway_labeler_controller

e2e-api-b-044266

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-044266

openshift-ingress

deployment-controller

e2e-api-b-044266-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-044266-openshift-default-95fddb794 from 0 to 1

openshift-ingress

multus

e2e-api-b-044266-openshift-default-95fddb794-86m9l

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-044266-85d877cb98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-044266-85d877cb98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-044266: serviceaccount "payload-processing-e2e-api-b-044266" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-044266-7c8d9895bf

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-044266-7c8d9895bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-044266: serviceaccount "payload-processing-e2e-api-b-044266" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-044266-85d877cb98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-044266

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-044266-85d877cb98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-044266

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-044266-7c8d9895bf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-044266-7c8d9895bf

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

openshift-ingress

kubelet

payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Unhealthy

Readiness probe failed: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

ProbeError

Readiness probe error: Get "http://10.132.0.84:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

ProbeError

Startup probe error: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Unhealthy

Startup probe failed: Get "http://10.132.0.84:15021/healthz/ready": dial tcp 10.132.0.84:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-3a1a62-7d596fcd66-5l8ll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-3a1a62-646854d7bc-chbts

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-3a1a62

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-3a1a62: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-3a1a62": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-3a1a62, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8bce454c-636c-4fb5-b359-1ff3dced1ade, UID in object meta:

openshift-ingress

kubelet

e2e-api-a-3a1a62-openshift-default-6b7c5698bd-27ckg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-044266-85d877cb98-rndks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-044266-7c8d9895bf-c2dmp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-044266-openshift-default-95fddb794-86m9l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-91c25e-df4454f99-6dfpw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-91c25e-5f5764b88b-w4xwn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-91c25e-openshift-default-7f779fbdb4-zl7kv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-837e16-9d88bd654-lzkdw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-837e16-659dff4b79-q6fvx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-837e16-openshift-default-6464f7596-5zptn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3dfe0c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3dfe0c

openshift-ingress

replicaset-controller

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd

SuccessfulCreate

Created pod: e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

openshift-ingress

deployment-controller

e2e-ipp-a-3dfe0c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd from 0 to 1

openshift-ingress

multus

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3dfe0c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c: serviceaccount "payload-processing-e2e-ipp-a-3dfe0c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3dfe0c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3dfe0c: serviceaccount "payload-processing-e2e-ipp-a-3dfe0c" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Unhealthy

Readiness probe failed: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

ProbeError

Readiness probe error: Get "http://10.134.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-636944

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-636944

openshift-ingress

multus

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-b-636944-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-636944-openshift-default-7f8bdf4444 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-636944-openshift-default-7f8bdf4444

SuccessfulCreate

Created pod: e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-636944

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-636944-58b969c559 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-636944-58b969c559

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-636944-58b969c559-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-636944: serviceaccount "payload-processing-e2e-ipp-b-636944" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-636944

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-636944-66d79f4c74 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-636944-58b969c559-52glp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-636944-58b969c559-52glp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-636944-58b969c559-52glp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-636944-58b969c559-52glp

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-636944-58b969c559

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-636944-58b969c559-52glp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-636944: serviceaccount "payload-processing-e2e-ipp-b-636944" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Unhealthy

Startup probe failed: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

ProbeError

Startup probe error: Get "http://10.134.0.68:15021/healthz/ready": dial tcp 10.134.0.68:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-361296

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-361296

openshift-ingress

deployment-controller

e2e-ipp-cleanup-361296-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4

SuccessfulCreate

Created pod: e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

openshift-ingress

multus

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-361296

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-361296

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-361296-7846f75c6f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-361296: serviceaccount "payload-processing-e2e-ipp-cleanup-361296" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-361296: serviceaccount "payload-processing-e2e-ipp-cleanup-361296" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd

AddedInterface

Add eth0 [10.132.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

AddedInterface

Add eth0 [10.132.0.91/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

ProbeError

Startup probe error: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Unhealthy

Startup probe failed: Get "http://10.134.0.69:15021/healthz/ready": dial tcp 10.134.0.69:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-361296-7ddd669d66-xpghd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-361296-7846f75c6f-m8xb8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

Unhealthy

Readiness probe failed: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-cleanup-361296-openshift-default-6c4d9f55c4-2bg78

ProbeError

Readiness probe error: Get "http://10.134.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-3dfe0c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-3dfe0c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-3dfe0c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5722040e-9db9-4e66-aca0-1726ffcd7189, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3dfe0c-645f8dcdf8-p8w9r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3dfe0c-7bddbb6b67-g5rgd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-3dfe0c-openshift-default-7f859c4fdd-rqmwn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-636944-58b969c559-52glp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-636944-66d79f4c74-g266z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-636944-openshift-default-7f8bdf4444-mfhgg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-8623b2-766c5bbfb5-zr64v

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-8623b2-7f6cf69bc8-vsbq4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-8623b2-openshift-default-5f4ddfbff8-s75gh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-4eb314-5776df85f9-nwr5g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-4eb314-776dd4d98-ng9bd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-4eb314-openshift-default-7ff666f8bd-xqww4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: