Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2 to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq to ip-10-0-132-113.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bctkc8q to ip-10-0-133-52.ec2.internal

openshift-ingress

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4 to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl to ip-10-0-133-52.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9m4jl to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64 to ip-10-0-132-113.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw to ip-10-0-133-52.ec2.internal

openshift-ingress

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9 to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7 to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

Scheduled

Successfully assigned openshift-ingress/e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59 to ip-10-0-133-52.ec2.internal

openshift-ingress

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-81fae671-openshift-default-6679d7c54d-52plk to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Scheduled

Successfully assigned openshift-ingress/e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc to ip-10-0-141-9.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-wfwsh

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-wfwsh to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748 to ip-10-0-141-9.ec2.internal

openshift-ingress

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr to ip-10-0-132-113.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-7w9zp

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-7w9zp to ip-10-0-141-9.ec2.internal

openshift-ingress

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256 to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7 to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-hlqmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-hlqmr to ip-10-0-141-9.ec2.internal

openshift-ingress

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-shz4m

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-shz4m to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd to ip-10-0-133-52.ec2.internal

openshift-ingress

kube-auth-proxy-86996bf9f5-5l4pj

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86996bf9f5-5l4pj to ip-10-0-141-9.ec2.internal

openshift-ingress

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8 to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

Scheduled

Successfully assigned openshift-ingress/e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf to ip-10-0-132-113.ec2.internal

openshift-ingress

router-default-c6c6bb47b-xc5lw

Scheduled

Successfully assigned openshift-ingress/router-default-c6c6bb47b-xc5lw to ip-10-0-141-9.ec2.internal

openshift-ingress

router-default-c6c6bb47b-xc5lw

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9 to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96 to ip-10-0-141-9.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q to ip-10-0-141-9.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8 to ip-10-0-141-9.ec2.internal

openshift-ingress

payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z to ip-10-0-132-113.ec2.internal

openshift-ingress

payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn to ip-10-0-141-9.ec2.internal

openshift-ingress

payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx to ip-10-0-132-113.ec2.internal

openshift-ingress

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb to ip-10-0-133-52.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d954782c-75694cf88c-qth6z to ip-10-0-132-113.ec2.internal

openshift-ingress

kube-auth-proxy-86996bf9f5-wz2lc

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-86996bf9f5-wz2lc to ip-10-0-133-52.ec2.internal

openshift-ingress

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr to ip-10-0-133-52.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-c6c6bb47b from 0 to 1

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer
(x12)

openshift-ingress

replicaset-controller

router-default-c6c6bb47b

FailedCreate

Error creating: pods "router-default-c6c6bb47b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-c6c6bb47b

FailedCreate

Error creating: pods "router-default-c6c6bb47b-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-c6c6bb47b

SuccessfulCreate

Created pod: router-default-c6c6bb47b-xc5lw
(x6)

openshift-ingress

kubelet

router-default-c6c6bb47b-xc5lw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-c6c6bb47b-xc5lw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-c6c6bb47b-xc5lw

AddedInterface

Add eth0 [10.132.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-c6c6bb47b-xc5lw

Started

Started container router

openshift-ingress

kubelet

router-default-c6c6bb47b-xc5lw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-c6c6bb47b-xc5lw

Created

Created container: router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-86996bf9f5 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-86996bf9f5

SuccessfulCreate

Created pod: kube-auth-proxy-86996bf9f5-5l4pj

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-5l4pj

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-86996bf9f5

FailedCreate

Error creating: pods "kube-auth-proxy-86996bf9f5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-86996bf9f5

SuccessfulCreate

Created pod: kube-auth-proxy-86996bf9f5-wz2lc

openshift-ingress

multus

kube-auth-proxy-86996bf9f5-wz2lc

AddedInterface

Add eth0 [10.133.0.16/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-7w9zp

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-wz2lc

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-wz2lc

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-7w9zp

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

kube-auth-proxy-86996bf9f5-5l4pj

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-5l4pj

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-5l4pj

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-5l4pj

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-5l4pj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.7s (2.7s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-wz2lc

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-wz2lc

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.693s (2.693s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-86996bf9f5-wz2lc

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 4.001s (4.001s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

AddedInterface

Add eth0 [10.133.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.782s (2.782s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.88s (2.88s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-jnxzw

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bctkc8q
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Unhealthy

Startup probe failed: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

ProbeError

Startup probe error: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bctkc8q

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-wfwsh

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-wfwsh

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wfwsh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wfwsh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.967s (3.967s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wfwsh

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-wfwsh

Created

Created container: discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-7w9zp

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-7w9zp
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-9m4jl

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.615s (2.615s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-hlqmr

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlqmr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-shz4m

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-shz4m

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-shz4m

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-hlqmr

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-shz4m

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.784s (1.784s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-shz4m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlqmr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.603s (1.603s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-shz4m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlqmr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-hlqmr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-9m4jl

ProbeError

Startup probe error: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d

SuccessfulCreate

Created pod: e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

openshift-ingress

deployment-controller

e2e-inf-a-1dfd6b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1dfd6b-openshift-default-769cc4f4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1dfd6b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1dfd6b

openshift-ingress

multus

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1dfd6b: serviceaccount "payload-processing-e2e-inf-a-1dfd6b" not found

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1dfd6b-9489786bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1dfd6b-9489786bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1dfd6b: serviceaccount "payload-processing-e2e-inf-a-1dfd6b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1dfd6b-9489786bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1dfd6b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1dfd6b-9489786bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1dfd6b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-84753aa3-openshift-default-67f9c584d8

SuccessfulCreate

Created pod: e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

openshift-ingress

gateway_labeler_controller

e2e-ait-84753aa3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-84753aa3

openshift-ingress

deployment-controller

e2e-ait-84753aa3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-84753aa3-openshift-default-67f9c584d8 from 0 to 1

openshift-ingress

multus

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-autores-1482ae

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-1482ae

openshift-ingress

replicaset-controller

e2e-autores-1482ae-openshift-default-7d4d7d7cdd

SuccessfulCreate

Created pod: e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

openshift-ingress

deployment-controller

e2e-autores-1482ae-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-1482ae-openshift-default-7d4d7d7cdd from 0 to 1

openshift-ingress

multus

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-84753aa3: serviceaccount "payload-processing-e2e-ait-84753aa3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-84753aa3-79464f9f8c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-84753aa3-79464f9f8c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-84753aa3: serviceaccount "payload-processing-e2e-ait-84753aa3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-84753aa3-79464f9f8c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

openshift-ingress

deployment-controller

payload-processing-e2e-ait-84753aa3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-84753aa3-79464f9f8c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-84753aa3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1482ae-64d8d45554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

openshift-ingress

multus

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1482ae-c97b58f87

SuccessfulCreate

Created pod: payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

openshift-ingress

kubelet

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-1482ae

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-1482ae-64d8d45554 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-1482ae

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-1482ae-c97b58f87 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-1482ae-64d8d45554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-1482ae-64d8d45554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1482ae: serviceaccount "payload-processing-e2e-autores-1482ae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-1482ae-c97b58f87

FailedCreate

Error creating: pods "payload-processing-e2e-autores-1482ae-c97b58f87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-1482ae: serviceaccount "payload-processing-e2e-autores-1482ae" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Unhealthy

Readiness probe failed: Get "http://10.133.0.25:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

ProbeError

Readiness probe error: Get "http://10.133.0.25:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Unhealthy

Startup probe failed: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

ProbeError

Startup probe error: Get "http://10.133.0.25:15021/healthz/ready": dial tcp 10.133.0.25:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

ProbeError

Readiness probe error: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Unhealthy

Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-inf-b-5ec585

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-5ec585
(x2)

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Started

Started container istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-5ec585-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-5ec585-openshift-default-5664665974 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-5ec585-openshift-default-5664665974

SuccessfulCreate

Created pod: e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd
(x2)

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-5ec585

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-5ec585-79dc8765db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5ec585: serviceaccount "payload-processing-e2e-inf-b-5ec585" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5ec585-77789bc79c

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-5ec585-77789bc79c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-5ec585: serviceaccount "payload-processing-e2e-inf-b-5ec585" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-5ec585

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-5ec585-77789bc79c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-5ec585-77789bc79c

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

Unhealthy

Startup probe failed: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

ProbeError

Startup probe error: Get "http://10.133.0.28:15021/healthz/ready": dial tcp 10.133.0.28:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-84753aa3-79464f9f8c-pmjjx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-84753aa3-5f9f69bf58-w65qf

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-c0e08d9a-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-c0e08d9a-gw

openshift-ingress

kubelet

e2e-ait-84753aa3-openshift-default-67f9c584d8-x2wln

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-c0e08d9a-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776

SuccessfulCreate

Created pod: e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

openshift-ingress

multus

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-c0e08d9a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-c0e08d9a-554745d694 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c0e08d9a: serviceaccount "payload-processing-e2e-migrate-c0e08d9a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-c0e08d9a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c0e08d9a-554745d694

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-c0e08d9a-554745d694-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-c0e08d9a: serviceaccount "payload-processing-e2e-migrate-c0e08d9a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-c0e08d9a-554745d694

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Unhealthy

Startup probe failed: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

ProbeError

Startup probe error: Get "http://10.133.0.30:15021/healthz/ready": dial tcp 10.133.0.30:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-c0e08d9a-554745d694-8lz7c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-c0e08d9a-7466c65bdb-fvjkx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-c0e08d9a-gw-openshift-default-74c8ccd776-p2mjv

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-d954782c-openshift-default-64b5f96744

SuccessfulCreate

Created pod: e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

openshift-ingress

deployment-controller

e2e-ait-d954782c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d954782c-openshift-default-64b5f96744 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-d954782c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d954782c

openshift-ingress

multus

payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d954782c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d954782c-75694cf88c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d954782c-75694cf88c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d954782c-75694cf88c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d954782c: serviceaccount "payload-processing-e2e-ait-d954782c" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d954782c-567689dcc8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d954782c-567689dcc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d954782c: serviceaccount "payload-processing-e2e-ait-d954782c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d954782c-567689dcc8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d954782c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d954782c-567689dcc8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d954782c-75694cf88c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

openshift-ingress

multus

payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Unhealthy

Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

ProbeError

Startup probe error: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-d954782c-75694cf88c-qth6z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d954782c-567689dcc8-7svdr

Killing

Stopping container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-b1ed35f1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b1ed35f1

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-b1ed35f1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b1ed35f1-openshift-default-f9489d756 from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b1ed35f1-openshift-default-f9489d756

SuccessfulCreate

Created pod: e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b1ed35f1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b1ed35f1-56f8886d85 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b1ed35f1-56f8886d85

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b1ed35f1-56f8886d85-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b1ed35f1: serviceaccount "payload-processing-e2e-derive-b1ed35f1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b1ed35f1: serviceaccount "payload-processing-e2e-derive-b1ed35f1" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b1ed35f1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b1ed35f1-56f8886d85

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

openshift-ingress

kubelet

payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

ProbeError

Readiness probe error: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ait-d954782c-openshift-default-64b5f96744-gkgqx

Unhealthy

Readiness probe failed: Get "http://10.133.0.34:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-1482ae-c97b58f87-mz5gn

Unhealthy

Readiness probe failed: dial tcp 10.134.0.38:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-1482ae-64d8d45554-nxd64

Unhealthy

Readiness probe failed: dial tcp 10.134.0.37:9004: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b1ed35f1-7cb8c5b58b-tz2ll

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b1ed35f1-56f8886d85-74bgr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-b1ed35f1-openshift-default-f9489d756-cwnpl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-autores-1482ae-openshift-default-7d4d7d7cdd-9d4pg

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-dfca8b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-dfca8b-openshift-default-6f7c66cdcb from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb

SuccessfulCreate

Created pod: e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

openshift-ingress

gateway_labeler_controller

e2e-explicit-dfca8b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-dfca8b

openshift-ingress

multus

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-dfca8b-6f485d86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-dfca8b-6f485d86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-dfca8b: serviceaccount "payload-processing-e2e-explicit-dfca8b" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-dfca8b-59db7989fc

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-dfca8b-59db7989fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-dfca8b: serviceaccount "payload-processing-e2e-explicit-dfca8b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-dfca8b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-dfca8b-6f485d86 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-dfca8b-6f485d86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-dfca8b-59db7989fc

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-dfca8b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-dfca8b-59db7989fc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Unhealthy

Startup probe failed: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

ProbeError

Startup probe error: Get "http://10.134.0.49:15021/healthz/ready": dial tcp 10.134.0.49:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-dfca8b-6f485d86-7hdk7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-dfca8b-59db7989fc-h5gsq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-4e801f-openshift-default-69d6564b68

SuccessfulCreate

Created pod: e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

openshift-ingress

gateway_labeler_controller

e2e-noten-4e801f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-4e801f

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-dfca8b-openshift-default-6f7c66cdcb-b8mrq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-noten-4e801f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-4e801f-openshift-default-69d6564b68 from 0 to 1

openshift-ingress

GatewayAuthBootstrap

e2e-noten-4e801f

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-noten-4e801f-authn-ssl: envoyfilters.networking.istio.io "e2e-noten-4e801f-authn-ssl" already exists

openshift-ingress

kubelet

e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-1dfd6b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-1dfd6b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-1dfd6b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-1dfd6b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 315635b6-9e70-43ee-8766-cd2d68aad022, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1dfd6b-d4bfc87c8-tncht

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1dfd6b-9489786bc-l9rkt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-1dfd6b-openshift-default-769cc4f4d-cgqmc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-mt-81fae671

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-81fae671

openshift-ingress

multus

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-81fae671-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-81fae671-openshift-default-6679d7c54d from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-81fae671-openshift-default-6679d7c54d

SuccessfulCreate

Created pod: e2e-mt-81fae671-openshift-default-6679d7c54d-52plk
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-81fae671-77968c8578

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-81fae671-77968c8578-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-81fae671: serviceaccount "payload-processing-e2e-mt-81fae671" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-81fae671

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-81fae671-77968c8578 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-81fae671-57ffddf489

FailedCreate

Error creating: pods "payload-processing-e2e-mt-81fae671-57ffddf489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-81fae671: serviceaccount "payload-processing-e2e-mt-81fae671" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-81fae671-57ffddf489

SuccessfulCreate

Created pod: payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

openshift-ingress

deployment-controller

payload-processing-e2e-mt-81fae671

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-81fae671-57ffddf489 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-81fae671-77968c8578

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-5ec585

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-5ec585: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-5ec585": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-5ec585, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fa41f3ec-00cf-424c-8b0d-a8b95429b25a, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-5ec585-79dc8765db-wgr2s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-5ec585-77789bc79c-wnkgc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-0aaff3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-0aaff3

openshift-ingress

replicaset-controller

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8

SuccessfulCreate

Created pod: e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

openshift-ingress

multus

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-b-5ec585-openshift-default-5664665974-7dlsd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-shared-a-w3-0aaff3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8 from 0 to 1

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:40956->10.133.0.43:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:40956->10.133.0.43:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0aaff3: serviceaccount "payload-processing-e2e-shared-a-w3-0aaff3" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-0aaff3: serviceaccount "payload-processing-e2e-shared-a-w3-0aaff3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-0aaff3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-0aaff3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-4e801f-openshift-default-69d6564b68-fqd8j

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-c443d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b

SuccessfulCreate

Created pod: e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-c443d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-c443d8

openshift-ingress

kubelet

payload-processing-e2e-mt-81fae671-57ffddf489-4hk8z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-81fae671-77968c8578-rl7jx

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-c443d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c443d8: serviceaccount "payload-processing-e2e-shared-b-w3-c443d8" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-c443d8: serviceaccount "payload-processing-e2e-shared-b-w3-c443d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-c443d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-c443d8-767fd8848f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-81fae671-openshift-default-6679d7c54d-52plk

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-6328f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-6328f9
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-a-w2-6328f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-6328f9-openshift-default-6ddf769678 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678

SuccessfulCreate

Created pod: e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6328f9-897999ffc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6328f9: serviceaccount "payload-processing-e2e-shared-a-w2-6328f9" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-6328f9-897999ffc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-6328f9-897999ffc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-6328f9: serviceaccount "payload-processing-e2e-shared-a-w2-6328f9" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-6328f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-6328f9-897999ffc from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-6328f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Unhealthy

Readiness probe failed: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

ProbeError

Readiness probe error: Get "http://10.133.0.49:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-shared-b-w2-a388e1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4

SuccessfulCreate

Created pod: e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a388e1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a388e1

openshift-ingress

multus

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a388e1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a388e1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a388e1: serviceaccount "payload-processing-e2e-shared-b-w2-a388e1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a388e1: serviceaccount "payload-processing-e2e-shared-b-w2-a388e1" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-25ae160a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-25ae160a-openshift-default-7f48c49fb8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-25ae160a-openshift-default-7f48c49fb8

SuccessfulCreate

Created pod: e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

openshift-ingress

gateway_labeler_controller

e2e-mt-25ae160a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-25ae160a

openshift-ingress

multus

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25ae160a: serviceaccount "payload-processing-e2e-mt-25ae160a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-25ae160a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-25ae160a-845ddf58f4 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-25ae160a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-25ae160a-9d658c4d5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25ae160a-9d658c4d5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-25ae160a-9d658c4d5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-25ae160a-9d658c4d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-25ae160a: serviceaccount "payload-processing-e2e-mt-25ae160a" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Unhealthy

Readiness probe failed: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

ProbeError

Readiness probe error: Get "http://10.134.0.65:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-25ae160a-845ddf58f4-fj748

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-25ae160a-9d658c4d5-ccqxn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-25ae160a-openshift-default-7f48c49fb8-pgzgr

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-61d831-openshift-default-7dbd7954b6

SuccessfulCreate

Created pod: e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

openshift-ingress

deployment-controller

e2e-api-a-61d831-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-61d831-openshift-default-7dbd7954b6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-61d831

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-61d831

openshift-ingress

multus

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-61d831-66f5c7d64f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-61d831-66f5c7d64f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-61d831: serviceaccount "payload-processing-e2e-api-a-61d831" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-61d831

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-61d831-7c55f8775d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-61d831-7c55f8775d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-61d831-7c55f8775d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-61d831: serviceaccount "payload-processing-e2e-api-a-61d831" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-61d831-66f5c7d64f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-61d831

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-61d831-66f5c7d64f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-61d831-7c55f8775d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.32s (2.32s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-9dd616

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-9dd616

openshift-ingress

deployment-controller

e2e-api-b-9dd616-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-9dd616-openshift-default-66668f94db from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-9dd616-openshift-default-66668f94db

SuccessfulCreate

Created pod: e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

openshift-ingress

multus

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9dd616-f9d69f89

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-9dd616-f9d69f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9dd616: serviceaccount "payload-processing-e2e-api-b-9dd616" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-9dd616

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-9dd616-696dd5bd54 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-9dd616: serviceaccount "payload-processing-e2e-api-b-9dd616" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-9dd616

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-9dd616-f9d69f89 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-9dd616-f9d69f89

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Unhealthy

Readiness probe failed: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

ProbeError

Readiness probe error: Get "http://10.133.0.61:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-61d831-66f5c7d64f-tf8c8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-61d831-7c55f8775d-dpdzk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-61d831-openshift-default-7dbd7954b6-zv2cn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-9dd616-f9d69f89-k7rrf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-9dd616-696dd5bd54-4zljn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-9dd616-openshift-default-66668f94db-kjkf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-6328f9-c4db985cd-2d4r7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-6328f9-897999ffc-g56pr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-6328f9-openshift-default-6ddf769678-v9sm9

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-processing-e2e-shared-b-w2-a388e1

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-shared-b-w2-a388e1: Operation cannot be fulfilled on endpoints "payload-processing-e2e-shared-b-w2-a388e1": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-shared-b-w2-a388e1, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b2758f2b-60a7-4b01-9401-bd46c54cf5ba, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a388e1-c56f54bb-qxrqc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a388e1-756bc56f5f-7kn96

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-a388e1-openshift-default-6bf75c56d4-d9zr4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

e2e-ipp-a-d46936-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d46936-openshift-default-585db4d5d6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d46936

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d46936

openshift-ingress

replicaset-controller

e2e-ipp-a-d46936-openshift-default-585db4d5d6

SuccessfulCreate

Created pod: e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

openshift-ingress

multus

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d46936

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d46936-558fbb7cbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d46936-558fbb7cbf

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d46936-66f964f786

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d46936-66f964f786-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d46936: serviceaccount "payload-processing-e2e-ipp-a-d46936" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d46936-558fbb7cbf

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d46936-558fbb7cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d46936: serviceaccount "payload-processing-e2e-ipp-a-d46936" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d46936

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d46936-66f964f786 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d46936-66f964f786

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

kubelet

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

ProbeError

Startup probe error: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

Unhealthy

Startup probe failed: Get "http://10.134.0.71:15021/healthz/ready": dial tcp 10.134.0.71:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c1a83e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c1a83e

openshift-ingress

deployment-controller

e2e-ipp-b-c1a83e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c1a83e-openshift-default-5d74564dc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4

SuccessfulCreate

Created pod: e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

openshift-ingress

multus

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c1a83e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c1a83e: serviceaccount "payload-processing-e2e-ipp-b-c1a83e" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c1a83e: serviceaccount "payload-processing-e2e-ipp-b-c1a83e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c1a83e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

Unhealthy

Startup probe failed: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

ProbeError

Startup probe error: Get "http://10.133.0.70:15021/healthz/ready": dial tcp 10.133.0.70:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8e268e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8e268e

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8e268e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8e268e-openshift-default-75975484b8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

openshift-ingress

multus

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8e268e: serviceaccount "payload-processing-e2e-ipp-cleanup-8e268e" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8e268e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8e268e: serviceaccount "payload-processing-e2e-ipp-cleanup-8e268e" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8e268e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

ProbeError

Readiness probe error: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Unhealthy

Readiness probe failed: Get "http://10.134.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

ProbeError

Startup probe error: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Unhealthy

Startup probe failed: Get "http://10.134.0.74:15021/healthz/ready": dial tcp 10.134.0.74:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8e268e-d9d6fccdb-4gqbg

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-8e268e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e268e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-8e268e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8e268e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 537d00d0-f659-410a-a23e-ffc822391caf, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8e268e-6b544d7647-b6f6n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-8e268e-openshift-default-75975484b8-vlpsb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d46936-558fbb7cbf-cm256

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d46936-66f964f786-zjt59

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-d46936-openshift-default-585db4d5d6-225n8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c1a83e-779f4fc6b9-v746s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c1a83e-68ff9f897d-qrgxm

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-c1a83e

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-c1a83e: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-c1a83e": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-c1a83e, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 207672b8-c43c-412b-9add-27fcec56b532, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-b-c1a83e-openshift-default-5d74564dc4-6j7fr

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-0aaff3

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0aaff3: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-0aaff3": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-0aaff3, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d0e99544-2314-412f-8dc3-d83c6ad92071, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-0aaff3-756d75f5fd-ngdfh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-0aaff3-8597854d8f-gh87q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-0aaff3-openshift-default-5b9f4dc4c8-x9cdl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-c443d8-767fd8848f-hq6pq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-c443d8-8495476d58-tq8d2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-c443d8-openshift-default-84cb85fc4b-8n2xb

Killing

Stopping container istio-proxy