Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8 to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp to ip-10-0-132-64.ec2.internal

openshift-ingress

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Scheduled

Successfully assigned openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv to ip-10-0-132-115.ec2.internal

openshift-ingress

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-jcw7s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-jcw7s to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr to ip-10-0-132-115.ec2.internal

openshift-ingress

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x to ip-10-0-132-64.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8 to ip-10-0-132-64.ec2.internal

openshift-ingress

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

Scheduled

Successfully assigned openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-cc3245-558cd97bfc-926wx to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-processing-e2e-mt-b902065f-784f769d89-vsfmt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-b902065f-784f769d89-vsfmt to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd to ip-10-0-132-115.ec2.internal

openshift-ingress

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

Scheduled

Successfully assigned openshift-ingress/e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn to ip-10-0-142-235.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2 to ip-10-0-132-115.ec2.internal

openshift-ingress

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

Scheduled

Successfully assigned openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp to ip-10-0-132-64.ec2.internal

openshift-ingress

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2 to ip-10-0-132-64.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-njkbb

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-njkbb to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4 to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4 to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

Scheduled

Successfully assigned openshift-ingress/e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf to ip-10-0-132-115.ec2.internal

openshift-ingress

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

Scheduled

Successfully assigned openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-t7dns

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-t7dns to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws to ip-10-0-132-64.ec2.internal

openshift-ingress

router-default-6cf6d56fcd-xqxl8

Scheduled

Successfully assigned openshift-ingress/router-default-6cf6d56fcd-xqxl8 to ip-10-0-142-235.ec2.internal

openshift-ingress

router-default-6cf6d56fcd-xqxl8

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 to ip-10-0-132-115.ec2.internal

openshift-ingress

kube-auth-proxy-54fc6bbcb5-dpr5w

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-54fc6bbcb5-dpr5w to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6 to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq to ip-10-0-132-64.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-v6zcm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-v6zcm to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb to ip-10-0-132-64.ec2.internal

openshift-ingress

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Scheduled

Successfully assigned openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4 to ip-10-0-142-235.ec2.internal

openshift-ingress

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt to ip-10-0-142-235.ec2.internal

openshift-ingress

kube-auth-proxy-54fc6bbcb5-89gwd

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-54fc6bbcb5-89gwd to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf to ip-10-0-132-115.ec2.internal

openshift-ingress

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf to ip-10-0-132-64.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br to ip-10-0-132-64.ec2.internal

openshift-ingress

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr to ip-10-0-142-235.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh to ip-10-0-132-64.ec2.internal

openshift-ingress

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 to ip-10-0-132-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd to ip-10-0-142-235.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6cf6d56fcd from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-6cf6d56fcd

FailedCreate

Error creating: pods "router-default-6cf6d56fcd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6cf6d56fcd

FailedCreate

Error creating: pods "router-default-6cf6d56fcd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6cf6d56fcd

SuccessfulCreate

Created pod: router-default-6cf6d56fcd-xqxl8
(x6)

openshift-ingress

kubelet

router-default-6cf6d56fcd-xqxl8

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6cf6d56fcd-xqxl8

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6cf6d56fcd-xqxl8

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

kubelet

router-default-6cf6d56fcd-xqxl8

Started

Started container router

openshift-ingress

kubelet

router-default-6cf6d56fcd-xqxl8

Created

Created container: router

openshift-ingress

multus

router-default-6cf6d56fcd-xqxl8

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-54fc6bbcb5 from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-54fc6bbcb5

FailedCreate

Error creating: pods "kube-auth-proxy-54fc6bbcb5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-dpr5w

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-54fc6bbcb5

SuccessfulCreate

Created pod: kube-auth-proxy-54fc6bbcb5-dpr5w

openshift-ingress

multus

kube-auth-proxy-54fc6bbcb5-89gwd

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-54fc6bbcb5

SuccessfulCreate

Created pod: kube-auth-proxy-54fc6bbcb5-89gwd

openshift-ingress

multus

kube-auth-proxy-54fc6bbcb5-dpr5w

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-89gwd

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-v6zcm

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-v6zcm

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-dpr5w

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-dpr5w

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-dpr5w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.919s (2.92s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-89gwd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.67s (2.67s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-89gwd

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-54fc6bbcb5-89gwd

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.461s (3.461s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.032s (3.032s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2

Started

Started container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-njkbb

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-njkbb

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-njkbb

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-njkbb

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-njkbb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-v6zcm

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-v6zcm

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-vhj5h

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-jcw7s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-t7dns

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-jcw7s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t7dns

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-jcw7s

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-t7dns

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-jcw7s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.784s (1.784s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t7dns

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-jcw7s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-jcw7s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t7dns

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t7dns

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.747s (1.747s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-vhj5h

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

openshift-ingress

multus

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ddf324

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ddf324

openshift-ingress

deployment-controller

e2e-inf-a-ddf324-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ddf324-openshift-default-7b5c898f9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-ddf324-openshift-default-7b5c898f9b

SuccessfulCreate

Created pod: e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ddf324

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ddf324-7c9c4bc95 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ddf324-7c9c4bc95

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ddf324-7c9c4bc95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ddf324: serviceaccount "payload-processing-e2e-inf-a-ddf324" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ddf324-7c9c4bc95

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ddf324

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ddf324: serviceaccount "payload-processing-e2e-inf-a-ddf324" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

e2e-autores-cc3245-openshift-default-679c9c8966

SuccessfulCreate

Created pod: e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.444s (2.444s including waiting). Image size: 166449337 bytes.

openshift-ingress

gateway_labeler_controller

e2e-autores-cc3245

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-cc3245

openshift-ingress

deployment-controller

e2e-autores-cc3245-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-cc3245-openshift-default-679c9c8966 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ait-9005ccc0-openshift-default-b8f69cb54

SuccessfulCreate

Created pod: e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

openshift-ingress

deployment-controller

e2e-ait-9005ccc0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-9005ccc0-openshift-default-b8f69cb54 from 0 to 1

openshift-ingress

multus

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

multus

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-9005ccc0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-9005ccc0

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9005ccc0-59d58f86b9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

openshift-ingress

deployment-controller

payload-processing-e2e-ait-9005ccc0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-9005ccc0-59d58f86b9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-9005ccc0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-9005ccc0-69969f598b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-9005ccc0-59d58f86b9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-9005ccc0-59d58f86b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9005ccc0: serviceaccount "payload-processing-e2e-ait-9005ccc0" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9005ccc0-69969f598b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-9005ccc0-69969f598b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-9005ccc0: serviceaccount "payload-processing-e2e-ait-9005ccc0" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-9005ccc0-69969f598b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

openshift-ingress

multus

payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-cc3245-558cd97bfc

FailedCreate

Error creating: pods "payload-processing-e2e-autores-cc3245-558cd97bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-cc3245: serviceaccount "payload-processing-e2e-autores-cc3245" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-cc3245-558cd97bfc

SuccessfulCreate

Created pod: payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

openshift-ingress

deployment-controller

payload-processing-e2e-autores-cc3245

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-cc3245-558cd97bfc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-cc3245-d75d48d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-cc3245-d75d48d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-cc3245: serviceaccount "payload-processing-e2e-autores-cc3245" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-cc3245-d75d48d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

openshift-ingress

kubelet

payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-cc3245

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-cc3245-d75d48d9d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.601s (1.601s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Unhealthy

Readiness probe failed: Get "http://10.134.0.34:15021/healthz/ready": read tcp 10.134.0.2:40144->10.134.0.34:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

ProbeError

Readiness probe error: Get "http://10.134.0.34:15021/healthz/ready": read tcp 10.134.0.2:40144->10.134.0.34:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": read tcp 10.134.0.2:52940->10.134.0.39:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": read tcp 10.134.0.2:52940->10.134.0.39:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-inf-b-d1a134-openshift-default-5f6bcb6596

SuccessfulCreate

Created pod: e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

openshift-ingress

deployment-controller

e2e-inf-b-d1a134-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d1a134-openshift-default-5f6bcb6596 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d1a134

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d1a134

openshift-ingress

GatewayAuthBootstrap

e2e-inf-b-d1a134

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-b-d1a134-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-b-d1a134-authn-ssl" already exists

openshift-ingress

multus

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d1a134

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d1a134-7f9c56c8f5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d1a134: serviceaccount "payload-processing-e2e-inf-b-d1a134" not found
(x2)

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d1a134

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d1a134: serviceaccount "payload-processing-e2e-inf-b-d1a134" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

endpoint-controller

payload-processing-e2e-ait-9005ccc0

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ait-9005ccc0: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ait-9005ccc0": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ait-9005ccc0, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 523b50af-8573-4769-9a44-b924b98a9ea5, UID in object meta:

openshift-ingress

kubelet

e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-9005ccc0-69969f598b-pkh9k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-9005ccc0-59d58f86b9-27ss6

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-2643d53e-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-2643d53e-gw

openshift-ingress

deployment-controller

e2e-migrate-2643d53e-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56

SuccessfulCreate

Created pod: e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.558s (2.558s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-2643d53e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2643d53e: serviceaccount "payload-processing-e2e-migrate-2643d53e" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-2643d53e: serviceaccount "payload-processing-e2e-migrate-2643d53e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-2643d53e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

openshift-ingress

kubelet

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-2643d53e-5cccd59b46-7vqr8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-2643d53e-5dfdcfd4d6-5ppgq

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-ait-df975900-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-df975900-openshift-default-f999d857b from 0 to 1

openshift-ingress

kubelet

e2e-migrate-2643d53e-gw-openshift-default-6cd6bb4b56-fsh8n

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-df975900

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-df975900

openshift-ingress

replicaset-controller

e2e-ait-df975900-openshift-default-f999d857b

SuccessfulCreate

Created pod: e2e-ait-df975900-openshift-default-f999d857b-t2rwj

openshift-ingress

multus

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-df975900-8578b8b4bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-df975900-8578b8b4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-df975900: serviceaccount "payload-processing-e2e-ait-df975900" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-df975900

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-df975900-8578b8b4bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-df975900

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-df975900-6bcd84cdf9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-df975900-6bcd84cdf9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-df975900-6bcd84cdf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-df975900: serviceaccount "payload-processing-e2e-ait-df975900" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-df975900-6bcd84cdf9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-df975900-8578b8b4bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-df975900-8578b8b4bb-4vw6f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-df975900-6bcd84cdf9-pxnw8

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-derive-e01e31eb-openshift-default-c55d9ccd8

SuccessfulCreate

Created pod: e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

openshift-ingress

deployment-controller

e2e-derive-e01e31eb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-e01e31eb-openshift-default-c55d9ccd8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-e01e31eb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-e01e31eb

openshift-ingress

kubelet

e2e-ait-df975900-openshift-default-f999d857b-t2rwj

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-cc3245-558cd97bfc-926wx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-cc3245-d75d48d9d-g65cd

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e01e31eb-5d8c8469d5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e01e31eb-64755b47d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-e01e31eb-64755b47d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-e01e31eb-64755b47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e01e31eb: serviceaccount "payload-processing-e2e-derive-e01e31eb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-e01e31eb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-e01e31eb-64755b47d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-e01e31eb-5d8c8469d5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-e01e31eb-5d8c8469d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-e01e31eb: serviceaccount "payload-processing-e2e-derive-e01e31eb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-e01e31eb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-e01e31eb-5d8c8469d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-e01e31eb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-e01e31eb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-e01e31eb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6c919434-d0ba-44ac-8ea8-fed78fe7666a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-e01e31eb-64755b47d-wrtrh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-e01e31eb-5d8c8469d5-xwlq2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-e01e31eb-openshift-default-c55d9ccd8-dkcwn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-7989d5-openshift-default-74bd6647fb

SuccessfulCreate

Created pod: e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

openshift-ingress

gateway_labeler_controller

e2e-explicit-7989d5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-7989d5

openshift-ingress

deployment-controller

e2e-explicit-7989d5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-7989d5-openshift-default-74bd6647fb from 0 to 1

openshift-ingress

multus

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7989d5-df8d468bf

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-7989d5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7989d5: serviceaccount "payload-processing-e2e-explicit-7989d5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-7989d5-df8d468bf

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-7989d5-df8d468bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-7989d5: serviceaccount "payload-processing-e2e-explicit-7989d5" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-7989d5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-7989d5-df8d468bf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-explicit-7989d5-df8d468bf-47phc

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-7989d5

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-7989d5: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-7989d5": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-7989d5, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 81c2c82d-7b57-4a83-aae7-7247940946da, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-7989d5-7f5d6bc5f8-7h6br

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-dfd2f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-dfd2f1

openshift-ingress

deployment-controller

e2e-noten-dfd2f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-dfd2f1-openshift-default-7c5577bdf4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-dfd2f1-openshift-default-7c5577bdf4

SuccessfulCreate

Created pod: e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

openshift-ingress

kubelet

e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

ProbeError

Readiness probe error: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt

Unhealthy

Readiness probe failed: Get "http://10.134.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

replicaset-controller

e2e-mt-b902065f-openshift-default-cd474c8dd

SuccessfulCreate

Created pod: e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

openshift-ingress

gateway_labeler_controller

e2e-mt-b902065f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-b902065f

openshift-ingress

deployment-controller

e2e-mt-b902065f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-b902065f-openshift-default-cd474c8dd from 0 to 1

openshift-ingress

multus

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-b902065f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-b902065f-597876cd4b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b902065f-597876cd4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-b902065f-597876cd4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b902065f: serviceaccount "payload-processing-e2e-mt-b902065f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b902065f-784f769d89

SuccessfulCreate

Created pod: payload-processing-e2e-mt-b902065f-784f769d89-vsfmt
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-b902065f-784f769d89

FailedCreate

Error creating: pods "payload-processing-e2e-mt-b902065f-784f769d89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-b902065f: serviceaccount "payload-processing-e2e-mt-b902065f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-b902065f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-b902065f-784f769d89 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-b902065f-597876cd4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

openshift-ingress

kubelet

payload-processing-e2e-mt-b902065f-784f769d89-vsfmt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-b902065f-784f769d89-vsfmt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-b902065f-784f769d89-vsfmt

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b902065f-784f769d89-vsfmt

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ddf324-7c9c4bc95-kgwr4

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d1a134-6cdb6b7f58-bxrh4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-58cd39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-58cd39-openshift-default-59958f88d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4

SuccessfulCreate

Created pod: e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-58cd39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-58cd39

openshift-ingress

multus

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39: serviceaccount "payload-processing-e2e-shared-a-w3-58cd39" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-b902065f-784f769d89-vsfmt

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-58cd39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-58cd39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39: serviceaccount "payload-processing-e2e-shared-a-w3-58cd39" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-b902065f-openshift-default-cd474c8dd-shrht

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

ProbeError

Readiness probe error: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Unhealthy

Readiness probe failed: Get "http://10.132.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Unhealthy

Startup probe failed: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

ProbeError

Startup probe error: Get "http://10.132.0.64:15021/healthz/ready": dial tcp 10.132.0.64:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-7a7e94

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-7a7e94

openshift-ingress

deployment-controller

e2e-shared-a-w2-7a7e94-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6

SuccessfulCreate

Created pod: e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

openshift-ingress

multus

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

multus

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-33b4cf-openshift-default-669686458d

SuccessfulCreate

Created pod: e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

openshift-ingress

deployment-controller

e2e-shared-b-w3-33b4cf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-33b4cf-openshift-default-669686458d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-33b4cf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-33b4cf

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-7a7e94

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94: serviceaccount "payload-processing-e2e-shared-a-w2-7a7e94" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-7a7e94

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-7a7e94: serviceaccount "payload-processing-e2e-shared-a-w2-7a7e94" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-33b4cf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf: serviceaccount "payload-processing-e2e-shared-b-w3-33b4cf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-33b4cf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf: serviceaccount "payload-processing-e2e-shared-b-w3-33b4cf" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Unhealthy

Readiness probe failed: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

ProbeError

Readiness probe error: Get "http://10.134.0.60:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-25e5bd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4 from 0 to 1
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

ProbeError

Startup probe error: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-25e5bd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-25e5bd

openshift-ingress

replicaset-controller

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4

SuccessfulCreate

Created pod: e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

multus

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd: serviceaccount "payload-processing-e2e-shared-b-w2-25e5bd" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-25e5bd: serviceaccount "payload-processing-e2e-shared-b-w2-25e5bd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-25e5bd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-25e5bd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-022f2a6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-022f2a6a

openshift-ingress

deployment-controller

e2e-mt-022f2a6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-022f2a6a-openshift-default-6576f78b4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-022f2a6a-openshift-default-6576f78b4

SuccessfulCreate

Created pod: e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

openshift-ingress

multus

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-022f2a6a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-022f2a6a-678549bfdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-022f2a6a-678549bfdf

SuccessfulCreate

Created pod: payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

openshift-ingress

multus

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-022f2a6a-678549bfdf

FailedCreate

Error creating: pods "payload-processing-e2e-mt-022f2a6a-678549bfdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-022f2a6a: serviceaccount "payload-processing-e2e-mt-022f2a6a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-022f2a6a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-022f2a6a-79d469986 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-022f2a6a-79d469986

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-022f2a6a-79d469986

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-022f2a6a-79d469986-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-022f2a6a: serviceaccount "payload-processing-e2e-mt-022f2a6a" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

Unhealthy

Startup probe failed: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

ProbeError

Startup probe error: Get "http://10.132.0.72:15021/healthz/ready": dial tcp 10.132.0.72:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw

Unhealthy

Readiness probe failed: dial tcp 10.134.0.65:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd

Unhealthy

Readiness probe failed: dial tcp 10.134.0.66:9004: i/o timeout

openshift-ingress

kubelet

e2e-mt-022f2a6a-openshift-default-6576f78b4-64gkn

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-03e78e-openshift-default-75d5698cb8

SuccessfulCreate

Created pod: e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

openshift-ingress

deployment-controller

e2e-api-a-03e78e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-03e78e-openshift-default-75d5698cb8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-03e78e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-03e78e

openshift-ingress

multus

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-03e78e-95fc55df9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-03e78e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-03e78e-c89f98bdb from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-03e78e: serviceaccount "payload-processing-e2e-api-a-03e78e" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-03e78e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-03e78e-95fc55df9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-03e78e-95fc55df9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-03e78e-95fc55df9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-03e78e: serviceaccount "payload-processing-e2e-api-a-03e78e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-ecb38e-openshift-default-58d4d7986

SuccessfulCreate

Created pod: e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

openshift-ingress

gateway_labeler_controller

e2e-api-b-ecb38e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ecb38e

openshift-ingress

deployment-controller

e2e-api-b-ecb38e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ecb38e-openshift-default-58d4d7986 from 0 to 1

openshift-ingress

multus

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ecb38e-9cf74846

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ecb38e-797b8bd697

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ecb38e-797b8bd697-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ecb38e: serviceaccount "payload-processing-e2e-api-b-ecb38e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ecb38e-797b8bd697

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ecb38e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ecb38e-797b8bd697 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ecb38e-9cf74846

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ecb38e-9cf74846-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ecb38e: serviceaccount "payload-processing-e2e-api-b-ecb38e" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ecb38e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ecb38e-9cf74846 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

ProbeError

Readiness probe error: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Unhealthy

Readiness probe failed: Get "http://10.132.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Unhealthy

Startup probe failed: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

ProbeError

Startup probe error: Get "http://10.132.0.75:15021/healthz/ready": dial tcp 10.132.0.75:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-03e78e-95fc55df9-z964h

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-03e78e-openshift-default-75d5698cb8-tql5p

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-ecb38e-797b8bd697-5rtnh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ecb38e-9cf74846-psb7k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-ecb38e-openshift-default-58d4d7986-7fz6r

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-7a7e94-65b5f9fcff-5t2zp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-7a7e94-54d7788978-8p6vc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

Unhealthy

Readiness probe failed: dial tcp 10.133.0.61:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-25e5bd-76449bb7f8-7vv8x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-25e5bd-5ffd7d5f49-nkmhv

Unhealthy

Readiness probe failed: dial tcp 10.133.0.62:9004: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-25e5bd-openshift-default-6d699865c4-nlqqr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b

SuccessfulCreate

Created pod: e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-16d0fd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-16d0fd

openshift-ingress

deployment-controller

e2e-ipp-a-16d0fd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b from 0 to 1

openshift-ingress

multus

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-16d0fd: serviceaccount "payload-processing-e2e-ipp-a-16d0fd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-16d0fd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-16d0fd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-16d0fd: serviceaccount "payload-processing-e2e-ipp-a-16d0fd" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

ProbeError

Readiness probe error: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Unhealthy

Readiness probe failed: Get "http://10.132.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Unhealthy

Startup probe failed: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

ProbeError

Startup probe error: Get "http://10.132.0.78:15021/healthz/ready": dial tcp 10.132.0.78:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-d28770-openshift-default-66985896b4

SuccessfulCreate

Created pod: e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

openshift-ingress

deployment-controller

e2e-ipp-b-d28770-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d28770-openshift-default-66985896b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d28770

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d28770

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-b-d28770

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-b-d28770-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-b-d28770-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d28770-757c48455f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d28770-757c48455f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d28770-757c48455f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d28770: serviceaccount "payload-processing-e2e-ipp-b-d28770" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d28770

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d28770: serviceaccount "payload-processing-e2e-ipp-b-d28770" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d28770

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d28770-757c48455f from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

ProbeError

Readiness probe error: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Unhealthy

Readiness probe failed: Get "http://10.132.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

ProbeError

Startup probe error: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Unhealthy

Startup probe failed: Get "http://10.132.0.79:15021/healthz/ready": dial tcp 10.132.0.79:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-6b8825

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-6b8825

openshift-ingress

deployment-controller

e2e-ipp-cleanup-6b8825-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b

SuccessfulCreate

Created pod: e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

openshift-ingress

multus

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-6b8825

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-6b8825-784598b77 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6b8825-784598b77

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-6b8825-784598b77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825: serviceaccount "payload-processing-e2e-ipp-cleanup-6b8825" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-6b8825: serviceaccount "payload-processing-e2e-ipp-cleanup-6b8825" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-6b8825-784598b77

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-6b8825

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

ProbeError

Startup probe error: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Unhealthy

Startup probe failed: Get "http://10.134.0.73:15021/healthz/ready": dial tcp 10.134.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-6b8825-6dbc78c96b-lfzdp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-6b8825-784598b77-mwzzk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-16d0fd-5fbc97dd79-ht6kf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-16d0fd-bd77d7d9d-g8bws

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-16d0fd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-16d0fd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-16d0fd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f742058a-3b1f-4353-a315-a20b063d4cee, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-16d0fd-openshift-default-7f55dbb45b-lxwpf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d28770-757c48455f-7lwnb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-d28770-openshift-default-66985896b4-fk29s

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-58cd39-openshift-default-59958f88d4-q4llt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-33b4cf

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-33b4cf": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 802464c0-ec21-477a-a61c-916cd8542f69, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58

Killing

Stopping container istio-proxy