Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8 to ip-10-0-139-13.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcj855z to ip-10-0-139-13.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-cdq9w to ip-10-0-139-13.ec2.internal

openshift-ingress

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Scheduled

Successfully assigned openshift-ingress/e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-j2rxj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-j2rxj to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt to ip-10-0-143-211.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8 to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq to ip-10-0-140-16.ec2.internal

openshift-ingress

kube-auth-proxy-df8dfc748-6hsvp

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-df8dfc748-6hsvp to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

Scheduled

Successfully assigned openshift-ingress/e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7 to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

Scheduled

Successfully assigned openshift-ingress/e2e-ait-814e2181-openshift-default-79874bf8f6-swn74 to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8 to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x to ip-10-0-139-13.ec2.internal

openshift-ingress

kube-auth-proxy-df8dfc748-4sgj9

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-df8dfc748-4sgj9 to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd to ip-10-0-139-13.ec2.internal

openshift-ingress

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

Scheduled

Successfully assigned openshift-ingress/e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92 to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2 to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6 to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth to ip-10-0-139-13.ec2.internal

openshift-ingress

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9 to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5 to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2 to ip-10-0-139-13.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-xvmpr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xvmpr to ip-10-0-140-16.ec2.internal

openshift-ingress

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8 to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96 to ip-10-0-143-211.ec2.internal

openshift-ingress

router-default-6c9c6b8bf6-9cgkq

Scheduled

Successfully assigned openshift-ingress/router-default-6c9c6b8bf6-9cgkq to ip-10-0-139-13.ec2.internal

openshift-ingress

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d to ip-10-0-143-211.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-nfww7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-nfww7 to ip-10-0-139-13.ec2.internal

openshift-ingress

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

Scheduled

Successfully assigned openshift-ingress/e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl to ip-10-0-139-13.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44 to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r to ip-10-0-143-211.ec2.internal

openshift-ingress

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g to ip-10-0-139-13.ec2.internal

openshift-ingress

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Scheduled

Successfully assigned openshift-ingress/e2e-autores-b42f08-openshift-default-8f44cc586-skc9l to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-j556w

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-j556w to ip-10-0-143-211.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6 to ip-10-0-140-16.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h to ip-10-0-143-211.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6c9c6b8bf6 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-6c9c6b8bf6

FailedCreate

Error creating: pods "router-default-6c9c6b8bf6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6c9c6b8bf6

FailedCreate

Error creating: pods "router-default-6c9c6b8bf6-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6c9c6b8bf6

SuccessfulCreate

Created pod: router-default-6c9c6b8bf6-9cgkq
(x6)

openshift-ingress

kubelet

router-default-6c9c6b8bf6-9cgkq

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-6c9c6b8bf6-9cgkq

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6c9c6b8bf6-9cgkq

Created

Created container: router

openshift-ingress

kubelet

router-default-6c9c6b8bf6-9cgkq

Started

Started container router

openshift-ingress

kubelet

router-default-6c9c6b8bf6-9cgkq

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-6c9c6b8bf6-9cgkq

AddedInterface

Add eth0 [10.132.0.10/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-df8dfc748

FailedCreate

Error creating: pods "kube-auth-proxy-df8dfc748-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-df8dfc748

SuccessfulCreate

Created pod: kube-auth-proxy-df8dfc748-6hsvp

openshift-ingress

replicaset-controller

kube-auth-proxy-df8dfc748

SuccessfulCreate

Created pod: kube-auth-proxy-df8dfc748-4sgj9

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-df8dfc748 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-6hsvp

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-xvmpr

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-4sgj9

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-df8dfc748-6hsvp

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-df8dfc748-4sgj9

AddedInterface

Add eth0 [10.134.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-xvmpr

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-4sgj9

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.599s (2.599s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-4sgj9

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-4sgj9

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-6hsvp

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-6hsvp

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.103s (3.103s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-df8dfc748-6hsvp

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.267s (3.267s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcj855z

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.614s (3.614s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.551s (3.551s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-sfh2p

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Unhealthy

Startup probe failed: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

ProbeError

Startup probe error: Get "http://10.132.0.27:15021/healthz/ready": dial tcp 10.132.0.27:15021: connect: connection refused body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcj855z

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcj855z

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-nfww7

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nfww7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-nfww7

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nfww7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.92s (2.92s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nfww7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-nfww7

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-xvmpr

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-xvmpr
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-cdq9w

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-j556w

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-j2rxj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-j2rxj

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-j556w

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-j556w

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j2rxj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-j556w

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j2rxj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.274s (1.274s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j2rxj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-j556w

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.192s (1.192s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-j556w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-j2rxj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

ProbeError

Readiness probe error: Get "http://10.132.0.30:15021/healthz/ready": read tcp 10.132.0.2:50070->10.132.0.30:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

Started

Started container istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

Unhealthy

Readiness probe failed: Get "http://10.132.0.30:15021/healthz/ready": read tcp 10.132.0.2:50070->10.132.0.30:15021: read: connection reset by peer
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

ProbeError

Startup probe error: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-cdq9w

Unhealthy

Startup probe failed: Get "http://10.132.0.30:15021/healthz/ready": dial tcp 10.132.0.30:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-worker-w4-ac76e5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-ac76e5-openshift-default-5d65795d4b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-ac76e5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-ac76e5

openshift-ingress

gateway_labeler_controller

e2e-inf-a-97d02d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-97d02d

openshift-ingress

deployment-controller

e2e-worker-w0-29d630-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-29d630-openshift-default-65f568fcd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-29d630

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-29d630

openshift-ingress

replicaset-controller

e2e-worker-w0-29d630-openshift-default-65f568fcd4

SuccessfulCreate

Created pod: e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

openshift-ingress

multus

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-97d02d-openshift-default-679d9c57d6

SuccessfulCreate

Created pod: e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

openshift-ingress

deployment-controller

e2e-inf-a-97d02d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-97d02d-openshift-default-679d9c57d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b

SuccessfulCreate

Created pod: e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

openshift-ingress

multus

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

multus

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-ac76e5: serviceaccount "payload-processing-e2e-worker-w4-ac76e5" not found

openshift-ingress

multus

payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-ac76e5-67996c48f

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-ac76e5-67996c48f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-ac76e5: serviceaccount "payload-processing-e2e-worker-w4-ac76e5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-ac76e5-67996c48f

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-ac76e5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-ac76e5-67996c48f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-ac76e5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

Started

Started container payload-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-29d630-7b77878895

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-29d630-7b77878895-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-29d630: serviceaccount "payload-processing-e2e-worker-w0-29d630" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-29d630-7b77878895

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-29d630

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-29d630-7b77878895 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-29d630

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-29d630-f755567f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-29d630-f755567f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-29d630-f755567f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-29d630-f755567f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-29d630: serviceaccount "payload-processing-e2e-worker-w0-29d630" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-autores-b42f08-openshift-default-8f44cc586

SuccessfulCreate

Created pod: e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-autores-b42f08

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-b42f08

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-b42f08-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-b42f08-openshift-default-8f44cc586 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-97d02d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-97d02d-76c48cc98f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-97d02d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-97d02d: serviceaccount "payload-processing-e2e-inf-a-97d02d" not found

openshift-ingress

multus

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-97d02d-76c48cc98f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-97d02d-76c48cc98f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-97d02d: serviceaccount "payload-processing-e2e-inf-a-97d02d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-97d02d-76c48cc98f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-814e2181-openshift-default-79874bf8f6

SuccessfulCreate

Created pod: e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

openshift-ingress

deployment-controller

e2e-ait-814e2181-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-814e2181-openshift-default-79874bf8f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-814e2181

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-814e2181

openshift-ingress

multus

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-b42f08

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-b42f08-66ffdbdb98 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b42f08-68dccddc7c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-b42f08-68dccddc7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b42f08: serviceaccount "payload-processing-e2e-autores-b42f08" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-b42f08

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-b42f08-68dccddc7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-b42f08-68dccddc7c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-b42f08: serviceaccount "payload-processing-e2e-autores-b42f08" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

openshift-ingress

multus

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-ait-814e2181

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-814e2181-fdfbd66bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-814e2181

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-814e2181-66cf86dcfd from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-814e2181-fdfbd66bc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

openshift-ingress

kubelet

payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-814e2181-fdfbd66bc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-814e2181-fdfbd66bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-814e2181: serviceaccount "payload-processing-e2e-ait-814e2181" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-814e2181: serviceaccount "payload-processing-e2e-ait-814e2181" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-e9bc87

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-e9bc87

openshift-ingress

replicaset-controller

e2e-inf-b-e9bc87-openshift-default-8d646b7dd

SuccessfulCreate

Created pod: e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

openshift-ingress

deployment-controller

e2e-inf-b-e9bc87-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-e9bc87-openshift-default-8d646b7dd from 0 to 1

openshift-ingress

multus

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

ProbeError

Startup probe error: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Unhealthy

Startup probe failed: Get "http://10.132.0.35:15021/healthz/ready": dial tcp 10.132.0.35:15021: connect: connection refused

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e9bc87-5985fc4bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-e9bc87

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-e9bc87-5985fc4bc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-e9bc87

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e9bc87: serviceaccount "payload-processing-e2e-inf-b-e9bc87" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-e9bc87-5985fc4bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-e9bc87-5985fc4bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-e9bc87: serviceaccount "payload-processing-e2e-inf-b-e9bc87" not found
(x2)

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-814e2181-66cf86dcfd-j789m

Killing

Stopping container payload-pre-processing
(x4)

openshift-ingress

kubelet

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-ait-814e2181-openshift-default-79874bf8f6-swn74

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-814e2181-fdfbd66bc-kwtnt

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-6347dad8-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-6347dad8-gw

openshift-ingress

deployment-controller

e2e-migrate-6347dad8-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b

SuccessfulCreate

Created pod: e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

openshift-ingress

multus

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-6347dad8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-6347dad8-6c997fc4bb from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-6347dad8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6347dad8: serviceaccount "payload-processing-e2e-migrate-6347dad8" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6347dad8-6c997fc4bb

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-6347dad8-6c997fc4bb

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-6347dad8-6c997fc4bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-6347dad8: serviceaccount "payload-processing-e2e-migrate-6347dad8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes
(x7)

openshift-ingress

kubelet

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

ProbeError

Startup probe error: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

Unhealthy

Startup probe failed: Get "http://10.132.0.38:15021/healthz/ready": dial tcp 10.132.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-6347dad8-578b5dffdb-tc4c8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-6347dad8-6c997fc4bb-xqd9r

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-917f4c86

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-917f4c86

openshift-ingress

replicaset-controller

e2e-ait-917f4c86-openshift-default-7fc5ddc6d

SuccessfulCreate

Created pod: e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

openshift-ingress

deployment-controller

e2e-ait-917f4c86-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-917f4c86-openshift-default-7fc5ddc6d from 0 to 1

openshift-ingress

multus

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-migrate-6347dad8-gw-openshift-default-85895b5f7b-xx7hn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-917f4c86-5576bb969d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

openshift-ingress

deployment-controller

payload-processing-e2e-ait-917f4c86

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-917f4c86-d5755c799 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-917f4c86

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-917f4c86-5576bb969d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-917f4c86-5576bb969d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-917f4c86-5576bb969d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-917f4c86: serviceaccount "payload-processing-e2e-ait-917f4c86" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-917f4c86-d5755c799

FailedCreate

Error creating: pods "payload-processing-e2e-ait-917f4c86-d5755c799-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-917f4c86: serviceaccount "payload-processing-e2e-ait-917f4c86" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-917f4c86-d5755c799

SuccessfulCreate

Created pod: payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

openshift-ingress

kubelet

payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

ProbeError

Startup probe error: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

Unhealthy

Startup probe failed: Get "http://10.132.0.41:15021/healthz/ready": dial tcp 10.132.0.41:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-917f4c86-5576bb969d-gkkqj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-917f4c86-d5755c799-s9f4v

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-b407aeb7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-b407aeb7

openshift-ingress

deployment-controller

e2e-derive-b407aeb7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-b407aeb7-openshift-default-676b45985b from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-b407aeb7-openshift-default-676b45985b

SuccessfulCreate

Created pod: e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

openshift-ingress

kubelet

e2e-ait-917f4c86-openshift-default-7fc5ddc6d-fcc92

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-derive-b407aeb7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-b407aeb7-6977947c69 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-b407aeb7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b407aeb7: serviceaccount "payload-processing-e2e-derive-b407aeb7" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b407aeb7-6977947c69

FailedCreate

Error creating: pods "payload-processing-e2e-derive-b407aeb7-6977947c69-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-b407aeb7: serviceaccount "payload-processing-e2e-derive-b407aeb7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-b407aeb7-6977947c69

SuccessfulCreate

Created pod: payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-b407aeb7-6d9585d8c8-5jfsp

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

Unhealthy

Startup probe failed: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-b407aeb7-openshift-default-676b45985b-zmffl

ProbeError

Startup probe error: Get "http://10.132.0.43:15021/healthz/ready": dial tcp 10.132.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-b407aeb7-6977947c69-zgdpg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-b42f08-68dccddc7c-4rhwk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-b42f08-66ffdbdb98-rj7x8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

e2e-explicit-2ff8fe-openshift-default-76f57f9d76

SuccessfulCreate

Created pod: e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-explicit-2ff8fe-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-2ff8fe-openshift-default-76f57f9d76 from 0 to 1

openshift-ingress

kubelet

e2e-autores-b42f08-openshift-default-8f44cc586-skc9l

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-2ff8fe

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-2ff8fe

openshift-ingress

multus

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2ff8fe: serviceaccount "payload-processing-e2e-explicit-2ff8fe" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-2ff8fe

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-2ff8fe: serviceaccount "payload-processing-e2e-explicit-2ff8fe" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-2ff8fe

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

openshift-ingress

kubelet

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-cdf667d8-openshift-default-56c85c6b4

SuccessfulCreate

Created pod: e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

openshift-ingress

deployment-controller

e2e-mt-cdf667d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cdf667d8-openshift-default-56c85c6b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-cdf667d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cdf667d8

openshift-ingress

multus

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cdf667d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cdf667d8-76cf8f97b5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cdf667d8-76cf8f97b5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cdf667d8: serviceaccount "payload-processing-e2e-mt-cdf667d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cdf667d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cdf667d8-76cf8f97b5 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cdf667d8: serviceaccount "payload-processing-e2e-mt-cdf667d8" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cdf667d8-76cf8f97b5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

openshift-ingress

multus

payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-2ff8fe-6c5fbc96d5-gw9bj

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-explicit-2ff8fe

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-explicit-2ff8fe: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-explicit-2ff8fe": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-explicit-2ff8fe, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ac4d6f89-21bc-4508-ad81-a6b2af67f74d, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-2ff8fe-659ffdd486-tk9g8

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-noten-710ce1-openshift-default-5998cc4f94

SuccessfulCreate

Created pod: e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

openshift-ingress

gateway_labeler_controller

e2e-noten-710ce1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-710ce1

openshift-ingress

kubelet

e2e-explicit-2ff8fe-openshift-default-76f57f9d76-26n4n

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-710ce1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-710ce1-openshift-default-5998cc4f94 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-cdf667d8-76cf8f97b5-qf7wp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cdf667d8-6bbf4c56c8-qm4zj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-cdf667d8-openshift-default-56c85c6b4-d66z8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-ec8230

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-ec8230

openshift-ingress

deployment-controller

e2e-shared-a-w2-ec8230-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4

SuccessfulCreate

Created pod: e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

openshift-ingress

multus

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ec8230-68db66c887

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-ec8230-68db66c887-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ec8230: serviceaccount "payload-processing-e2e-shared-a-w2-ec8230" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-ec8230: serviceaccount "payload-processing-e2e-shared-a-w2-ec8230" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-ec8230

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-ec8230-68db66c887 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-ec8230-68db66c887

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-ec8230

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Unhealthy

Startup probe failed: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

ProbeError

Startup probe error: Get "http://10.132.0.49:15021/healthz/ready": dial tcp 10.132.0.49:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68

SuccessfulCreate

Created pod: e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

openshift-ingress

deployment-controller

e2e-shared-b-w2-6dca39-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-6dca39

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-6dca39

openshift-ingress

multus

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6dca39: serviceaccount "payload-processing-e2e-shared-b-w2-6dca39" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-6dca39: serviceaccount "payload-processing-e2e-shared-b-w2-6dca39" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-6dca39

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-6dca39

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-6dca39-677c566b6c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-noten-710ce1-openshift-default-5998cc4f94-slpwm

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-mt-cc097cc5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-cc097cc5

openshift-ingress

replicaset-controller

e2e-mt-cc097cc5-openshift-default-688ccd7b9b

SuccessfulCreate

Created pod: e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

openshift-ingress

deployment-controller

e2e-mt-cc097cc5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-cc097cc5-openshift-default-688ccd7b9b from 0 to 1

openshift-ingress

multus

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cc097cc5: serviceaccount "payload-processing-e2e-mt-cc097cc5" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-cc097cc5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-cc097cc5-757dff96bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-cc097cc5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-cc097cc5-5ff94cfcf7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-cc097cc5: serviceaccount "payload-processing-e2e-mt-cc097cc5" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

openshift-ingress

kubelet

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-97d02d-76c48cc98f-ss25q

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-97d02d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-97d02d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-97d02d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-97d02d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 31f3ba20-429c-4a9f-8152-b24c0c3e03df, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-97d02d-6bb9f4985d-qhzfq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Unhealthy

Readiness probe failed: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

ProbeError

Readiness probe error: Get "http://10.132.0.52:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-97d02d-openshift-default-679d9c57d6-854pq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-e9bc87-6d4556dcf4-7lpl2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-e9bc87-5985fc4bc-qv7pw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-e9bc87-openshift-default-8d646b7dd-rgdth

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-2b3936-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-2b3936-openshift-default-6559d7f858 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-2b3936

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-2b3936

openshift-ingress

replicaset-controller

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858

SuccessfulCreate

Created pod: e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

openshift-ingress

multus

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-2b3936

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2b3936: serviceaccount "payload-processing-e2e-shared-a-w3-2b3936" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-2b3936

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-2b3936: serviceaccount "payload-processing-e2e-shared-a-w3-2b3936" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-32bbbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4

SuccessfulCreate

Created pod: e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-32bbbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-32bbbb

openshift-ingress

multus

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-32bbbb: serviceaccount "payload-processing-e2e-shared-b-w3-32bbbb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-32bbbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-32bbbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-32bbbb: serviceaccount "payload-processing-e2e-shared-b-w3-32bbbb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

AddedInterface

Add eth0 [10.134.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

AddedInterface

Add eth0 [10.134.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-cc097cc5-757dff96bb-b9j96

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-cc097cc5-5ff94cfcf7-847xs

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-cc097cc5-openshift-default-688ccd7b9b-lqdmh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-25d1cb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-25d1cb

openshift-ingress

deployment-controller

e2e-api-a-25d1cb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-25d1cb-openshift-default-75f4bb6c8b from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b

SuccessfulCreate

Created pod: e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

openshift-ingress

multus

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-25d1cb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-25d1cb-7fb89fc677 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-25d1cb-7fb89fc677

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-25d1cb-7fb89fc677

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-25d1cb-7fb89fc677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-25d1cb: serviceaccount "payload-processing-e2e-api-a-25d1cb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-25d1cb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-25d1cb-884576fd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-25d1cb-884576fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-25d1cb-884576fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-25d1cb: serviceaccount "payload-processing-e2e-api-a-25d1cb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-25d1cb-884576fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-api-b-0848f9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-0848f9

openshift-ingress

deployment-controller

e2e-api-b-0848f9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-0848f9-openshift-default-794996ffc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-b-0848f9-openshift-default-794996ffc6

SuccessfulCreate

Created pod: e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

openshift-ingress

multus

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-0848f9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-0848f9-d89f976c5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0848f9: serviceaccount "payload-processing-e2e-api-b-0848f9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0848f9-d89f976c5

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-0848f9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-0848f9-9bd7d447d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-0848f9-d89f976c5

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-0848f9-d89f976c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-0848f9: serviceaccount "payload-processing-e2e-api-b-0848f9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

openshift-ingress

kubelet

payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

AddedInterface

Add eth0 [10.133.0.96/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Unhealthy

Readiness probe failed: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

ProbeError

Readiness probe error: Get "http://10.132.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-25d1cb-884576fd-994kt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-25d1cb-7fb89fc677-qgx2r

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

ProbeError

Startup probe error: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Unhealthy

Startup probe failed: Get "http://10.132.0.63:15021/healthz/ready": dial tcp 10.132.0.63:15021: connect: connection refused

openshift-ingress

kubelet

e2e-api-a-25d1cb-openshift-default-75f4bb6c8b-nph2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-0848f9-9bd7d447d-pv86q

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-0848f9-d89f976c5-pk87f

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-0848f9-openshift-default-794996ffc6-2pvfv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-ec8230-7657cc6b4b-lntqr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-ec8230-68db66c887-x22dq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w2-ec8230-openshift-default-789cdbcd4-whvtm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-6dca39-89968d878-bn79h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-6dca39-677c566b6c-89jch

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-6dca39-openshift-default-5c7cbb5b68-hlg9g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-29d630-7b77878895-bbrpm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-29d630-f755567f8-btsqt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-29d630-openshift-default-65f568fcd4-d5j2d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-ac76e5-67996c48f-hsk44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-ac76e5-5dc6dd99f8-x4rmm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-ac76e5-openshift-default-5d65795d4b-rj2cd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-7139fb

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-7139fb-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-7139fb-authn-ssl" already exists

openshift-ingress

multus

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

AddedInterface

Add eth0 [10.133.0.108/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-7139fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-7139fb

openshift-ingress

deployment-controller

e2e-ipp-a-7139fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-7139fb-openshift-default-c64dfcf74 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-7139fb-openshift-default-c64dfcf74

SuccessfulCreate

Created pod: e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7139fb: serviceaccount "payload-processing-e2e-ipp-a-7139fb" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-7139fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7139fb-87479c56f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-7139fb-87479c56f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-7139fb: serviceaccount "payload-processing-e2e-ipp-a-7139fb" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-7139fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-7139fb-87479c56f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-7139fb-87479c56f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

ProbeError

Startup probe error: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

Unhealthy

Startup probe failed: Get "http://10.133.0.108:15021/healthz/ready": dial tcp 10.133.0.108:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-ipp-b-74aca3-openshift-default-84f65574f8

SuccessfulCreate

Created pod: e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

openshift-ingress

deployment-controller

e2e-ipp-b-74aca3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-74aca3-openshift-default-84f65574f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-74aca3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-74aca3

openshift-ingress

multus

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

AddedInterface

Add eth0 [10.133.0.109/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-74aca3-579c5c5c89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-74aca3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-74aca3-579c5c5c89 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-74aca3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-74aca3: serviceaccount "payload-processing-e2e-ipp-b-74aca3" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-74aca3-579c5c5c89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-74aca3-579c5c5c89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-74aca3: serviceaccount "payload-processing-e2e-ipp-b-74aca3" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9

AddedInterface

Add eth0 [10.133.0.110/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

AddedInterface

Add eth0 [10.133.0.111/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Unhealthy

Startup probe failed: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

ProbeError

Startup probe error: Get "http://10.133.0.109:15021/healthz/ready": dial tcp 10.133.0.109:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8

SuccessfulCreate

Created pod: e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

openshift-ingress

deployment-controller

e2e-ipp-cleanup-5fd646-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-5fd646

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-5fd646

openshift-ingress

multus

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-5fd646

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5fd646: serviceaccount "payload-processing-e2e-ipp-cleanup-5fd646" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-5fd646

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-5fd646-6d954f869 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-5fd646: serviceaccount "payload-processing-e2e-ipp-cleanup-5fd646" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

ProbeError

Startup probe error: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

Unhealthy

Startup probe failed: Get "http://10.132.0.65:15021/healthz/ready": dial tcp 10.132.0.65:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-5fd646-65f74fbb54-tpzt5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-5fd646-6d954f869-r9qn6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-5fd646-openshift-default-dff5bfcf8-z26kl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-7139fb-8d55ddfd6-f4mh6

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-7139fb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-7139fb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-7139fb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-7139fb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 43593639-ce17-439a-a89b-96dce7632caf, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-7139fb-87479c56f-zdksh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-7139fb-openshift-default-c64dfcf74-fvwtp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74aca3-579c5c5c89-zwdzh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74aca3-67db9cdbdb-ml2t9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-74aca3-openshift-default-84f65574f8-5hm2b

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-2b3936-5dd97b5f7c-x5jr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-2b3936-7894556c8b-st4nh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-2b3936-openshift-default-6559d7f858-kzmr2

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-32bbbb-8494dd8855-kz22x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-32bbbb-6b9f96f76b-stx7n

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w3-32bbbb

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w3-32bbbb: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w3-32bbbb": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w3-32bbbb, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 80646e34-c50d-4795-9ce2-56cb5c2dc39e, UID in object meta:

openshift-ingress

kubelet

e2e-shared-b-w3-32bbbb-openshift-default-5fbcbc85d4-dj42x

Killing

Stopping container istio-proxy