Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956 to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Scheduled

Successfully assigned openshift-ingress/e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5 to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8 to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

Scheduled

Successfully assigned openshift-ingress/e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-g2ncf

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-g2ncf to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5 to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76 to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6 to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4 to ip-10-0-133-109.ec2.internal

openshift-ingress

kube-auth-proxy-7ff57cc6b9-r4f9g

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ff57cc6b9-r4f9g to ip-10-0-133-109.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-v4qdh to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-7c2684c9-769db79665-q66pp to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3a652320-7bd648857c-v5597

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3a652320-7bd648857c-v5597 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r to ip-10-0-133-109.ec2.internal

openshift-ingress

kube-auth-proxy-7ff57cc6b9-bnldt

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7ff57cc6b9-bnldt to ip-10-0-128-29.ec2.internal

openshift-ingress

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42 to ip-10-0-133-109.ec2.internal

openshift-ingress

router-default-64477965b8-nbp56

Scheduled

Successfully assigned openshift-ingress/router-default-64477965b8-nbp56 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

Scheduled

Successfully assigned openshift-ingress/e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-dnhtk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-dnhtk to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs to ip-10-0-141-255.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-r7bxr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-r7bxr to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Scheduled

Successfully assigned openshift-ingress/e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

Scheduled

Successfully assigned openshift-ingress/e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2 to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k to ip-10-0-133-109.ec2.internal

openshift-ingress

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw to ip-10-0-141-255.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cvgj87 to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx to ip-10-0-141-255.ec2.internal

openshift-ingress

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

Scheduled

Successfully assigned openshift-ingress/e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7 to ip-10-0-141-255.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch to ip-10-0-133-109.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql to ip-10-0-141-255.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-wph6l

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-wph6l to ip-10-0-133-109.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-64477965b8 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-64477965b8

FailedCreate

Error creating: pods "router-default-64477965b8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-64477965b8

FailedCreate

Error creating: pods "router-default-64477965b8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-64477965b8

SuccessfulCreate

Created pod: router-default-64477965b8-nbp56

openshift-ingress

taint-eviction-controller

router-default-64477965b8-nbp56

TaintManagerEviction

Cancelling deletion of Pod openshift-ingress/router-default-64477965b8-nbp56
(x6)

openshift-ingress

kubelet

router-default-64477965b8-nbp56

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-64477965b8-nbp56

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-64477965b8-nbp56

AddedInterface

Add eth0 [10.134.0.8/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-64477965b8-nbp56

Created

Created container: router

openshift-ingress

kubelet

router-default-64477965b8-nbp56

Started

Started container router

openshift-ingress

kubelet

router-default-64477965b8-nbp56

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

replicaset-controller

kube-auth-proxy-7ff57cc6b9

SuccessfulCreate

Created pod: kube-auth-proxy-7ff57cc6b9-r4f9g

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7ff57cc6b9 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7ff57cc6b9

SuccessfulCreate

Created pod: kube-auth-proxy-7ff57cc6b9-bnldt
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-7ff57cc6b9

FailedCreate

Error creating: pods "kube-auth-proxy-7ff57cc6b9-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-7ff57cc6b9-bnldt

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-bnldt

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7ff57cc6b9-r4f9g

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-r4f9g

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-wph6l

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-wph6l

AddedInterface

Add eth0 [10.132.0.23/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-r4f9g

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.698s (2.698s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-bnldt

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-r4f9g

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-bnldt

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.642s (2.642s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-bnldt

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7ff57cc6b9-r4f9g

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 5.381s (5.381s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

AddedInterface

Add eth0 [10.134.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.021s (3.021s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799cvgj87

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-r7bxr

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7bxr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-r7bxr

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7bxr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.829s (2.829s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7bxr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-r7bxr

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-wph6l

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-wph6l
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-v4qdh

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.966s (2.966s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dnhtk

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-g2ncf

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-dnhtk

AddedInterface

Add eth0 [10.134.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g2ncf

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-dnhtk

openshift-ingress

multus

payload-processing-5b54b7fbb7-g2ncf

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g2ncf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g2ncf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g2ncf

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.998s (1.998s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dnhtk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dnhtk

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-dnhtk

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.489s (2.489s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

ProbeError

Startup probe error: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-v4qdh

Unhealthy

Startup probe failed: Get "http://10.132.0.40:15021/healthz/ready": dial tcp 10.132.0.40:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-worker-w4-4e0b0b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w4-4e0b0b

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-f8a2d4

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-f8a2d4

openshift-ingress

gateway_labeler_controller

e2e-inf-a-93598a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-93598a

openshift-ingress

replicaset-controller

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d

SuccessfulCreate

Created pod: e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

openshift-ingress

multus

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8

SuccessfulCreate

Created pod: e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

openshift-ingress

deployment-controller

e2e-worker-w0-f8a2d4-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8 from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-93598a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-93598a-openshift-default-7cd7f95d76 from 0 to 1

openshift-ingress

multus

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w4-4e0b0b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-93598a-openshift-default-7cd7f95d76

SuccessfulCreate

Created pod: e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

openshift-ingress

multus

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f8a2d4: serviceaccount "payload-processing-e2e-worker-w0-f8a2d4" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-f8a2d4

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-f8a2d4

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-f8a2d4-84db594f7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-f8a2d4: serviceaccount "payload-processing-e2e-worker-w0-f8a2d4" not found

openshift-ingress

replicaset-controller

e2e-autores-736ba3-openshift-default-85cbfc4798

SuccessfulCreate

Created pod: e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn

Created

Created container: payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4e0b0b: serviceaccount "payload-processing-e2e-worker-w4-4e0b0b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w4-4e0b0b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb from 0 to 1

openshift-ingress

multus

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w4-4e0b0b: serviceaccount "payload-processing-e2e-worker-w4-4e0b0b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

openshift-ingress

deployment-controller

e2e-autores-736ba3-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-736ba3-openshift-default-85cbfc4798 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w4-4e0b0b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-736ba3

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-736ba3

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-93598a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-93598a-86bc5c88c5 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-93598a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-93598a-7867756478 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-93598a-7867756478

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

openshift-ingress

multus

payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-93598a-7867756478

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-93598a-7867756478-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-93598a: serviceaccount "payload-processing-e2e-inf-a-93598a" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-93598a-86bc5c88c5

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

openshift-ingress

kubelet

payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-93598a-86bc5c88c5

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-93598a-86bc5c88c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-93598a: serviceaccount "payload-processing-e2e-inf-a-93598a" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-736ba3-c754bcfbf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-736ba3-c754bcfbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-736ba3: serviceaccount "payload-processing-e2e-autores-736ba3" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-736ba3-c754bcfbf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-736ba3

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-736ba3-575f5cb8b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-33958e97

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-33958e97

openshift-ingress

deployment-controller

e2e-ait-33958e97-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-33958e97-openshift-default-6cdb6877d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-33958e97-openshift-default-6cdb6877d

SuccessfulCreate

Created pod: e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

openshift-ingress

deployment-controller

payload-processing-e2e-autores-736ba3

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-736ba3-c754bcfbf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-736ba3-575f5cb8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-736ba3-575f5cb8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-736ba3: serviceaccount "payload-processing-e2e-autores-736ba3" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-736ba3-575f5cb8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

openshift-ingress

kubelet

payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

Started

Started container payload-processing

openshift-ingress

multus

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-d59a02

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-d59a02

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-33958e97

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-33958e97-5c79855854 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-d59a02-openshift-default-6696b85c4

SuccessfulCreate

Created pod: e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-33958e97-5c79855854

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

openshift-ingress

deployment-controller

payload-processing-e2e-ait-33958e97

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-33958e97-5744fc4cbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-33958e97-5744fc4cbf

SuccessfulCreate

Created pod: payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-33958e97-5744fc4cbf

FailedCreate

Error creating: pods "payload-processing-e2e-ait-33958e97-5744fc4cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-33958e97: serviceaccount "payload-processing-e2e-ait-33958e97" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-33958e97-5c79855854

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-33958e97-5c79855854-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-33958e97: serviceaccount "payload-processing-e2e-ait-33958e97" not found

openshift-ingress

deployment-controller

e2e-inf-b-d59a02-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-d59a02-openshift-default-6696b85c4 from 0 to 1

openshift-ingress

multus

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Unhealthy

Startup probe failed: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

ProbeError

Startup probe error: Get "http://10.132.0.52:15021/healthz/ready": dial tcp 10.132.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

ProbeError

Startup probe error: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Unhealthy

Startup probe failed: Get "http://10.134.0.29:15021/healthz/ready": dial tcp 10.134.0.29:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-d59a02

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-d59a02-5949b5bbc7 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-d59a02

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-d59a02-8f778cd from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d59a02-5949b5bbc7

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-d59a02-5949b5bbc7

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-d59a02-5949b5bbc7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d59a02: serviceaccount "payload-processing-e2e-inf-b-d59a02" not found

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:39278->10.132.0.51:15021: read: connection reset by peer
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d59a02-8f778cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-d59a02-8f778cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-d59a02: serviceaccount "payload-processing-e2e-inf-b-d59a02" not found
(x2)

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-d59a02-8f778cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq
(x2)

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:39278->10.132.0.51:15021: read: connection reset by peer body:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

Created

Created container: istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Unhealthy

Readiness probe failed: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:45150->10.132.0.61:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

ProbeError

Readiness probe error: Get "http://10.132.0.61:15021/healthz/ready": read tcp 10.132.0.2:45150->10.132.0.61:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Created

Created container: istio-proxy
(x7)

openshift-ingress

kubelet

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Unhealthy

Startup probe failed: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused
(x7)

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

ProbeError

Startup probe error: Get "http://10.132.0.61:15021/healthz/ready": dial tcp 10.132.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-33958e97-openshift-default-6cdb6877d-mbtmx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-33958e97-5c79855854-75bfx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-33958e97-5744fc4cbf-jcxvl

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-44ba3006-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-44ba3006-gw

openshift-ingress

replicaset-controller

e2e-migrate-44ba3006-gw-openshift-default-9857697b4

SuccessfulCreate

Created pod: e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

openshift-ingress

deployment-controller

e2e-migrate-44ba3006-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-44ba3006-gw-openshift-default-9857697b4 from 0 to 1

openshift-ingress

multus

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-44ba3006-5cd897666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-44ba3006-5cd897666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-44ba3006: serviceaccount "payload-processing-e2e-migrate-44ba3006" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-44ba3006-77c7c8b56b

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-44ba3006-77c7c8b56b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-44ba3006: serviceaccount "payload-processing-e2e-migrate-44ba3006" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-44ba3006-77c7c8b56b

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-44ba3006

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-44ba3006-77c7c8b56b from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-44ba3006

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-44ba3006-5cd897666 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-44ba3006-5cd897666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

openshift-ingress

kubelet

payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-44ba3006-5cd897666-4nzph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-44ba3006

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-44ba3006: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-44ba3006": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-44ba3006, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ea1a07bb-cf92-46d7-ae9c-a5f515824282, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-migrate-44ba3006-77c7c8b56b-gzf56

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-820e15b2-openshift-default-574cc56b46

SuccessfulCreate

Created pod: e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

openshift-ingress

deployment-controller

e2e-ait-820e15b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-820e15b2-openshift-default-574cc56b46 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-820e15b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-820e15b2

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-44ba3006-gw-openshift-default-9857697b4-ltdrw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-820e15b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-820e15b2-77b5567ff8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-820e15b2: serviceaccount "payload-processing-e2e-ait-820e15b2" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-820e15b2-57bddd4cb5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-820e15b2-57bddd4cb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-820e15b2: serviceaccount "payload-processing-e2e-ait-820e15b2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-820e15b2-57bddd4cb5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

openshift-ingress

deployment-controller

payload-processing-e2e-ait-820e15b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-820e15b2-57bddd4cb5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-820e15b2-77b5567ff8-dz8dx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-736ba3-575f5cb8b-s2kb8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-736ba3-c754bcfbf-9dp4l

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

ProbeError

Startup probe error: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ait-820e15b2-57bddd4cb5-ghpnm

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

Unhealthy

Startup probe failed: Get "http://10.132.0.67:15021/healthz/ready": dial tcp 10.132.0.67:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-820e15b2-openshift-default-574cc56b46-tsx2b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-85c5a226

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-85c5a226

openshift-ingress

replicaset-controller

e2e-derive-85c5a226-openshift-default-54df4d46b8

SuccessfulCreate

Created pod: e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

openshift-ingress

multus

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-derive-85c5a226-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-85c5a226-openshift-default-54df4d46b8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-85c5a226

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-85c5a226

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-85c5a226-5b6d8699fc from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-85c5a226: serviceaccount "payload-processing-e2e-derive-85c5a226" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-85c5a226-5b6d8699fc

FailedCreate

Error creating: pods "payload-processing-e2e-derive-85c5a226-5b6d8699fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-85c5a226: serviceaccount "payload-processing-e2e-derive-85c5a226" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-85c5a226-5b6d8699fc

SuccessfulCreate

Created pod: payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

openshift-ingress

multus

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-85c5a226-openshift-default-54df4d46b8-nrmj7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-85c5a226-5b6d8699fc-zwk4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-85c5a226-5bcfdf7bcd-r8q76

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-autores-736ba3-openshift-default-85cbfc4798-2z7t2

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-aedf1a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-aedf1a

openshift-ingress

deployment-controller

e2e-explicit-aedf1a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-aedf1a-openshift-default-6dd478f644 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-aedf1a-openshift-default-6dd478f644

SuccessfulCreate

Created pod: e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

openshift-ingress

multus

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-aedf1a: serviceaccount "payload-processing-e2e-explicit-aedf1a" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-aedf1a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-aedf1a-659977fd7d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-aedf1a: serviceaccount "payload-processing-e2e-explicit-aedf1a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-aedf1a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

openshift-ingress

multus

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-7c2684c9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-7c2684c9

openshift-ingress

deployment-controller

e2e-mt-7c2684c9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-7c2684c9-openshift-default-757cdf7b84 from 0 to 1

openshift-ingress

multus

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-mt-7c2684c9-openshift-default-757cdf7b84

SuccessfulCreate

Created pod: e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7c2684c9: serviceaccount "payload-processing-e2e-mt-7c2684c9" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

openshift-ingress

kubelet

payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7c2684c9-769db79665

SuccessfulCreate

Created pod: payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

openshift-ingress

multus

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-7c2684c9-769db79665

FailedCreate

Error creating: pods "payload-processing-e2e-mt-7c2684c9-769db79665-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-7c2684c9: serviceaccount "payload-processing-e2e-mt-7c2684c9" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-7c2684c9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-7c2684c9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-7c2684c9-769db79665 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-7c2684c9

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-7c2684c9: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-7c2684c9": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-7c2684c9, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3f13bee8-3784-417e-aa6e-a7215f718200, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-mt-7c2684c9-769db79665-q66pp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-7c2684c9-788d8b75d6-fncbx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-7c2684c9-openshift-default-757cdf7b84-m2mth

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w2-b05610-openshift-default-646bbf8

SuccessfulCreate

Created pod: e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

openshift-ingress

deployment-controller

e2e-shared-a-w2-b05610-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-b05610-openshift-default-646bbf8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-b05610

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-b05610

openshift-ingress

multus

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-aedf1a-659977fd7d-t2dh5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-aedf1a-7b5b4ffd7c-sp5hf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b05610: serviceaccount "payload-processing-e2e-shared-a-w2-b05610" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

AddedInterface

Add eth0 [10.132.0.79/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

AddedInterface

Add eth0 [10.132.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-b05610

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-b05610: serviceaccount "payload-processing-e2e-shared-a-w2-b05610" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-b05610

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-b05610-6b85b9d889 from 0 to 1

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-cd668b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-cd668b-openshift-default-5ffd59f45d from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-cd668b-openshift-default-5ffd59f45d

SuccessfulCreate

Created pod: e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

openshift-ingress

gateway_labeler_controller

e2e-noten-cd668b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-cd668b

openshift-ingress

kubelet

e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

AddedInterface

Add eth0 [10.132.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-aedf1a-openshift-default-6dd478f644-vjndq

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-90057a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-90057a

openshift-ingress

multus

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

AddedInterface

Add eth0 [10.132.0.82/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-90057a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-90057a-openshift-default-598cc5f744 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-90057a-openshift-default-598cc5f744

SuccessfulCreate

Created pod: e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

Unhealthy

Startup probe failed: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

ProbeError

Startup probe error: Get "http://10.134.0.48:15021/healthz/ready": dial tcp 10.134.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-90057a-57949c658c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-90057a-57949c658c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-90057a: serviceaccount "payload-processing-e2e-shared-b-w2-90057a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-90057a-57949c658c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-90057a: serviceaccount "payload-processing-e2e-shared-b-w2-90057a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-90057a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-90057a-57949c658c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-90057a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

ProbeError

Readiness probe error: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Unhealthy

Readiness probe failed: Get "http://10.132.0.82:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

ProbeError

Startup probe error: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Unhealthy

Startup probe failed: Get "http://10.132.0.82:15021/healthz/ready": dial tcp 10.132.0.82:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-3a652320-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3a652320-openshift-default-64c9fffd96 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-3a652320-openshift-default-64c9fffd96

SuccessfulCreate

Created pod: e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

openshift-ingress

gateway_labeler_controller

e2e-mt-3a652320

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3a652320

openshift-ingress

multus

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-3a652320-7bd648857c-v5597

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3a652320-5f96cb5766

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3a652320-5f96cb5766-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3a652320: serviceaccount "payload-processing-e2e-mt-3a652320" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3a652320-5f96cb5766

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3a652320

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3a652320-5f96cb5766 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3a652320

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3a652320-7bd648857c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3a652320-7bd648857c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3a652320-7bd648857c-v5597
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3a652320-7bd648857c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3a652320-7bd648857c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3a652320: serviceaccount "payload-processing-e2e-mt-3a652320" not found

openshift-ingress

kubelet

payload-processing-e2e-mt-3a652320-7bd648857c-v5597

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3a652320-7bd648857c-v5597

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3a652320-7bd648857c-v5597

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-cd668b-openshift-default-5ffd59f45d-xt47w

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

ProbeError

Startup probe error: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

Unhealthy

Startup probe failed: Get "http://10.132.0.87:15021/healthz/ready": dial tcp 10.132.0.87:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-93598a-86bc5c88c5-4wknx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-93598a-7867756478-szjsz

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-93598a-openshift-default-7cd7f95d76-hsd42

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-d59a02

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-d59a02: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-d59a02": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-d59a02, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7d2b9113-8184-4fea-b063-6639a2e437cd, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-b-d59a02-5949b5bbc7-drzn9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-d59a02-8f778cd-zhrsq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-d59a02-openshift-default-6696b85c4-qvzqt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-a5bbf6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-a5bbf6

openshift-ingress

deployment-controller

e2e-shared-a-w3-a5bbf6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8

SuccessfulCreate

Created pod: e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

openshift-ingress

multus

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

AddedInterface

Add eth0 [10.132.0.98/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a5bbf6: serviceaccount "payload-processing-e2e-shared-a-w3-a5bbf6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-a5bbf6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-a5bbf6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

AddedInterface

Add eth0 [10.132.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

AddedInterface

Add eth0 [10.132.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

Started

Started container payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-a5bbf6: serviceaccount "payload-processing-e2e-shared-a-w3-a5bbf6" not found

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Unhealthy

Readiness probe failed: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-5d35e7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-5d35e7

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

ProbeError

Readiness probe error: Get "http://10.132.0.98:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-5d35e7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b

SuccessfulCreate

Created pod: e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

openshift-ingress

multus

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Unhealthy

Startup probe failed: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

ProbeError

Startup probe error: Get "http://10.132.0.98:15021/healthz/ready": dial tcp 10.132.0.98:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-5d35e7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5d35e7: serviceaccount "payload-processing-e2e-shared-b-w3-5d35e7" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-5d35e7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-5d35e7: serviceaccount "payload-processing-e2e-shared-b-w3-5d35e7" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-3a652320-7bd648857c-v5597

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3a652320-5f96cb5766-6z7f8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-3a652320-openshift-default-64c9fffd96-h5fvf

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8

SuccessfulCreate

Created pod: e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

openshift-ingress

gateway_labeler_controller

e2e-api-a-684bbd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-684bbd

openshift-ingress

deployment-controller

e2e-api-a-684bbd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-684bbd-openshift-default-6d8c4fb5d8 from 0 to 1

openshift-ingress

multus

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

AddedInterface

Add eth0 [10.132.0.108/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-684bbd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-684bbd-5b97b8d6f9 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

AddedInterface

Add eth0 [10.132.0.109/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-684bbd-5b97b8d6f9

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-684bbd-5b97b8d6f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-684bbd: serviceaccount "payload-processing-e2e-api-a-684bbd" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-684bbd-7767459458

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-684bbd-7767459458-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-684bbd: serviceaccount "payload-processing-e2e-api-a-684bbd" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-684bbd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-684bbd-7767459458 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-684bbd-7767459458

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-684bbd-5b97b8d6f9

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-b-794d1c-openshift-default-64fcc6d786

SuccessfulCreate

Created pod: e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

openshift-ingress

deployment-controller

e2e-api-b-794d1c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-794d1c-openshift-default-64fcc6d786 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-794d1c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-794d1c

openshift-ingress

multus

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-794d1c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-794d1c-f6b5cd69c

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-794d1c-f6b5cd69c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-794d1c: serviceaccount "payload-processing-e2e-api-b-794d1c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-794d1c-f6b5cd69c

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-794d1c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-794d1c-f6b5cd69c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-794d1c: serviceaccount "payload-processing-e2e-api-b-794d1c" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

Unhealthy

Startup probe failed: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

ProbeError

Startup probe error: Get "http://10.132.0.108:15021/healthz/ready": dial tcp 10.132.0.108:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-f8a2d4-84db594f7c-chzfn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-f8a2d4-774c48fc94-lb8ch

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-684bbd-7767459458-r9gql

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-684bbd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-684bbd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-684bbd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-684bbd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 12688e8c-a18e-491e-a6f9-b7164cc1a142, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-684bbd-5b97b8d6f9-k8dtp

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w0-f8a2d4-openshift-default-76c675c9c8-hff6m

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-684bbd-openshift-default-6d8c4fb5d8-4lwf6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-794d1c-f6b5cd69c-42cd6

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-b-794d1c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-b-794d1c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-b-794d1c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-b-794d1c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 03ebfe5b-9349-45c5-805a-14e0a24a6fa6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-794d1c-7df8bd6c74-m5z9s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-794d1c-openshift-default-64fcc6d786-8gndj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-b05610-6b85b9d889-hnsfz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-b05610-74fd7b75db-vsc2k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-b05610-openshift-default-646bbf8-frnmf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-worker-w4-4e0b0b-6f6c558bcc-5xl6g

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w4-4e0b0b-57865b6dbb-dq2cs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-90057a-75bc68ff8-bpvwx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-90057a-57949c658c-5ktm7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-worker-w4-4e0b0b-openshift-default-6f58f6fd5d-679ds

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w2-90057a-openshift-default-598cc5f744-5fpg4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb

SuccessfulCreate

Created pod: e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

openshift-ingress

deployment-controller

e2e-ipp-a-be394b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-be394b-openshift-default-7d5b5c6fb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-be394b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-be394b

openshift-ingress

multus

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-be394b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-be394b-678b7479bb from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-be394b: serviceaccount "payload-processing-e2e-ipp-a-be394b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5

AddedInterface

Add eth0 [10.132.0.121/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-be394b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-be394b-fbdc9b7c9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-be394b: serviceaccount "payload-processing-e2e-ipp-a-be394b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Unhealthy

Readiness probe failed: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

ProbeError

Readiness probe error: Get "http://10.134.0.59:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-74a302

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-74a302

openshift-ingress

deployment-controller

e2e-ipp-b-74a302-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-74a302-openshift-default-76997f94d6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-74a302-openshift-default-76997f94d6

SuccessfulCreate

Created pod: e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

openshift-ingress

multus

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

AddedInterface

Add eth0 [10.132.0.122/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

AddedInterface

Add eth0 [10.132.0.124/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-74a302-86bdb8487c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-74a302

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

AddedInterface

Add eth0 [10.132.0.123/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-74a302

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-74a302-86bdb8487c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-74a302: serviceaccount "payload-processing-e2e-ipp-b-74a302" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-74a302-86bdb8487c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-74a302-86bdb8487c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-74a302: serviceaccount "payload-processing-e2e-ipp-b-74a302" not found
(x2)

openshift-ingress

kubelet

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

Unhealthy

Startup probe failed: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

ProbeError

Startup probe error: Get "http://10.132.0.122:15021/healthz/ready": dial tcp 10.132.0.122:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-cleanup-b2aace

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-cleanup-b2aace-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-cleanup-b2aace-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-b2aace

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-b2aace

openshift-ingress

deployment-controller

e2e-ipp-cleanup-b2aace-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb

SuccessfulCreate

Created pod: e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

openshift-ingress

multus

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-b2aace

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b2aace: serviceaccount "payload-processing-e2e-ipp-cleanup-b2aace" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

AddedInterface

Add eth0 [10.132.0.125/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-b2aace

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-b2aace: serviceaccount "payload-processing-e2e-ipp-cleanup-b2aace" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

AddedInterface

Add eth0 [10.132.0.126/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

ProbeError

Startup probe error: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

Unhealthy

Startup probe failed: Get "http://10.134.0.62:15021/healthz/ready": dial tcp 10.134.0.62:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-b2aace-647c5b96f9-6fzrc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-b2aace-5b4fbfb4b-lvvdz

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-b2aace

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2aace: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-b2aace": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-b2aace, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 8beca3f8-6471-4e53-8347-c2c7a3c040e7, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-cleanup-b2aace-openshift-default-676d5466fb-8fd2k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-be394b-678b7479bb-dx7z5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-be394b-fbdc9b7c9-9d5gw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-be394b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-be394b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-be394b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-be394b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 6d6385a6-c8da-46fb-9650-6471de28471d, UID in object meta:

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-a-be394b-openshift-default-7d5b5c6fb-j4kzj

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-74a302-796f97bd6b-g8vpl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-74a302-86bdb8487c-kz5zz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-74a302-openshift-default-76997f94d6-gj8rz

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-a5bbf6-c47bcb859-pg956

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-a5bbf6-65f76fb646-v8r4r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-a5bbf6-openshift-default-55f47b9dd8-8fj6l

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-5d35e7-554f8fddbc-cr78c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-5d35e7-84df4fb4b6-ddt8d

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-5d35e7-openshift-default-5549f7c85b-hbrb9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503