Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7 to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn to ip-10-0-135-225.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55 to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb to ip-10-0-135-225.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-w79z4

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-w79z4 to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Scheduled

Successfully assigned openshift-ingress/e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7 to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t to ip-10-0-137-55.ec2.internal

openshift-ingress

kube-auth-proxy-569b779d49-bsbr8

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-569b779d49-bsbr8 to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj to ip-10-0-135-225.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6 to ip-10-0-135-225.ec2.internal

openshift-ingress

kube-auth-proxy-569b779d49-cpwrh

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-569b779d49-cpwrh to ip-10-0-142-56.ec2.internal

openshift-ingress

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5 to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq to ip-10-0-135-225.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-7tf4c to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-ltz8r

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-ltz8r to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

Scheduled

Successfully assigned openshift-ingress/e2e-ait-60623346-openshift-default-74b46659c6-ttl2k to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

Scheduled

Successfully assigned openshift-ingress/e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86 to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

Scheduled

Successfully assigned openshift-ingress/e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-6cd864bc95-st4pq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-6cd864bc95-st4pq to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8 to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7 to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4 to ip-10-0-135-225.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-fdh4p

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-fdh4p to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-5d7dbbd56b-4455c

Scheduled

Successfully assigned openshift-ingress/payload-processing-5d7dbbd56b-4455c to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42 to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ba321c07-549495cf89-n5df4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ba321c07-549495cf89-n5df4 to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89 to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb to ip-10-0-137-55.ec2.internal

openshift-ingress

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-xzt6s

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-xzt6s to ip-10-0-142-56.ec2.internal

openshift-ingress

payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

Scheduled

Successfully assigned openshift-ingress/e2e-derive-74a27a74-openshift-default-ff859598d-56dv9 to ip-10-0-135-225.ec2.internal

openshift-ingress

router-default-ff46cf8-5t75c

Scheduled

Successfully assigned openshift-ingress/router-default-ff46cf8-5t75c to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7 to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s to ip-10-0-135-225.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p to ip-10-0-137-55.ec2.internal

openshift-ingress

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m to ip-10-0-135-225.ec2.internal

openshift-ingress

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8 to ip-10-0-137-55.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-ff46cf8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x15)

openshift-ingress

replicaset-controller

router-default-ff46cf8

FailedCreate

Error creating: pods "router-default-ff46cf8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-ff46cf8

FailedCreate

Error creating: pods "router-default-ff46cf8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-ff46cf8

SuccessfulCreate

Created pod: router-default-ff46cf8-5t75c
(x6)

openshift-ingress

kubelet

router-default-ff46cf8-5t75c

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-ff46cf8-5t75c

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

kubelet

router-default-ff46cf8-5t75c

Created

Created container: router

openshift-ingress

kubelet

router-default-ff46cf8-5t75c

Started

Started container router

openshift-ingress

kubelet

router-default-ff46cf8-5t75c

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine

openshift-ingress

multus

router-default-ff46cf8-5t75c

AddedInterface

Add eth0 [10.133.0.13/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

kube-auth-proxy-569b779d49

SuccessfulCreate

Created pod: kube-auth-proxy-569b779d49-cpwrh

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-569b779d49 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-569b779d49

SuccessfulCreate

Created pod: kube-auth-proxy-569b779d49-bsbr8
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-569b779d49

FailedCreate

Error creating: pods "kube-auth-proxy-569b779d49-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

multus

kube-auth-proxy-569b779d49-bsbr8

AddedInterface

Add eth0 [10.133.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-bsbr8

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-cpwrh

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-569b779d49-cpwrh

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-w79z4

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-w79z4

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-bsbr8

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-bsbr8

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.882s (2.882s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-bsbr8

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-cpwrh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.006s (3.006s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-cpwrh

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-569b779d49-cpwrh

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.81s (3.81s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.704s (2.704s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-89qm6

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.011s (3.011s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

ProbeError

Startup probe error: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcfl5tw

Unhealthy

Startup probe failed: Get "http://10.134.0.32:15021/healthz/ready": dial tcp 10.134.0.32:15021: connect: connection refused

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fdh4p

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fdh4p

Created

Created container: discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-fdh4p

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fdh4p

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-fdh4p

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fdh4p

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-fdh4p

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-w79z4

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-w79z4
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-7tf4c

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-ltz8r

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-xzt6s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-ltz8r

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-xzt6s

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xzt6s

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltz8r

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltz8r

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.214s (1.214s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltz8r

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltz8r

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xzt6s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xzt6s

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.667s (2.667s including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xzt6s

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-7tf4c

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ltz8r

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-xzt6s

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-6cd864bc95 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-6cd864bc95

SuccessfulCreate

Created pod: payload-pre-processing-6cd864bc95-st4pq

openshift-ingress

replicaset-controller

payload-processing-5d7dbbd56b

SuccessfulCreate

Created pod: payload-processing-5d7dbbd56b-4455c

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5d7dbbd56b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-st4pq

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

multus

payload-pre-processing-6cd864bc95-st4pq

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5d7dbbd56b-4455c

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-4455c

Pulling

Pulling image "quay.io/opendatahub/odh-praxis-extproc:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-st4pq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-4455c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-4455c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-4455c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.038s (1.038s including waiting). Image size: 141123057 bytes.

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-st4pq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-praxis-extproc:odh-stable" in 1.011s (1.011s including waiting). Image size: 141123057 bytes.

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-st4pq

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-worker-w0-482177-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w0-482177-openshift-default-6b76b97566 from 0 to 1

openshift-ingress

deployment-controller

e2e-inf-a-033feb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-033feb-openshift-default-68d977bdcb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-033feb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-033feb

openshift-ingress

multus

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-a-033feb-openshift-default-68d977bdcb

SuccessfulCreate

Created pod: e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

openshift-ingress

multus

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-worker-w3-d0c9f2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w3-d0c9f2

openshift-ingress

replicaset-controller

e2e-worker-w0-482177-openshift-default-6b76b97566

SuccessfulCreate

Created pod: e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

openshift-ingress

gateway_labeler_controller

e2e-worker-w0-482177

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-worker-w0-482177

openshift-ingress

replicaset-controller

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8

SuccessfulCreate

Created pod: e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

openshift-ingress

multus

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-worker-w3-d0c9f2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w0-482177

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w0-482177-5469cc445d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-482177-5469cc445d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w0-482177

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w0-482177-75756ff869 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w0-482177-5469cc445d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w0-482177-5469cc445d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-482177: serviceaccount "payload-processing-e2e-worker-w0-482177" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-482177-75756ff869

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w0-482177-75756ff869

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w0-482177-75756ff869-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w0-482177: serviceaccount "payload-processing-e2e-worker-w0-482177" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-d0c9f2-7699d77785

FailedCreate

Error creating: pods "payload-processing-e2e-worker-w3-d0c9f2-7699d77785-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2: serviceaccount "payload-processing-e2e-worker-w3-d0c9f2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

Started

Started container payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-worker-w3-d0c9f2: serviceaccount "payload-processing-e2e-worker-w3-d0c9f2" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

openshift-ingress

deployment-controller

payload-pre-processing-e2e-worker-w3-d0c9f2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-worker-w3-d0c9f2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-worker-w3-d0c9f2-7699d77785 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-worker-w3-d0c9f2-7699d77785

SuccessfulCreate

Created pod: payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-033feb-6b45d795bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-033feb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-033feb-6b45d795bc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-033feb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-033feb-8bc5cf78 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-033feb: serviceaccount "payload-processing-e2e-inf-a-033feb" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-033feb-6b45d795bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-033feb-6b45d795bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-033feb: serviceaccount "payload-processing-e2e-inf-a-033feb" not found

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 620ms (620ms including waiting). Image size: 166449312 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.437s (1.437s including waiting). Image size: 166449312 bytes.

openshift-ingress

multus

payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Unhealthy

Readiness probe failed: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

ProbeError

Readiness probe error: Get "http://10.133.0.37:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Unhealthy

Readiness probe failed: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

ProbeError

Readiness probe error: Get "http://10.133.0.38:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

ProbeError

Startup probe error: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Unhealthy

Startup probe failed: Get "http://10.133.0.37:15021/healthz/ready": dial tcp 10.133.0.37:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-inf-b-a58460-openshift-default-7fb6cb84f6

SuccessfulCreate

Created pod: e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

openshift-ingress

multus

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a58460

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a58460

openshift-ingress

deployment-controller

e2e-inf-b-a58460-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a58460-openshift-default-7fb6cb84f6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a58460

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a58460-6b9597c679 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a58460

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a58460: serviceaccount "payload-processing-e2e-inf-b-a58460" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a58460-6b9597c679

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a58460-6b9597c679

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a58460-6b9597c679-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a58460: serviceaccount "payload-processing-e2e-inf-b-a58460" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

Unhealthy

Startup probe failed: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

ProbeError

Startup probe error: Get "http://10.134.0.55:15021/healthz/ready": dial tcp 10.134.0.55:15021: connect: connection refused body:

openshift-ingress

multus

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-ba321c07

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ba321c07

openshift-ingress

deployment-controller

e2e-ait-ba321c07-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ba321c07-openshift-default-5cbd44d58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-ba321c07-openshift-default-5cbd44d58

SuccessfulCreate

Created pod: e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ba321c07

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ba321c07: serviceaccount "payload-processing-e2e-ait-ba321c07" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ba321c07

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ba321c07-549495cf89 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ba321c07-549495cf89

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ba321c07-549495cf89-n5df4
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ba321c07-549495cf89

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ba321c07-549495cf89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ba321c07: serviceaccount "payload-processing-e2e-ait-ba321c07" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-ba321c07-549495cf89-n5df4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ba321c07-549495cf89-n5df4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ba321c07-549495cf89-n5df4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-ba321c07-549495cf89-n5df4

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

ProbeError

Startup probe error: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Unhealthy

Startup probe failed: Get "http://10.133.0.49:15021/healthz/ready": dial tcp 10.133.0.49:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-a-033feb-6b45d795bc-n4t4k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-033feb-8bc5cf78-zpn5p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ba321c07-549495cf89-n5df4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ba321c07-7fdbbd7cd6-v58tt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-ba321c07-openshift-default-5cbd44d58-4tsbp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-3f6bf6aa-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-3f6bf6aa-gw

openshift-ingress

deployment-controller

e2e-migrate-3f6bf6aa-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b

SuccessfulCreate

Created pod: e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

openshift-ingress

kubelet

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa: serviceaccount "payload-processing-e2e-migrate-3f6bf6aa" not found

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-3f6bf6aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-3f6bf6aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-3f6bf6aa: serviceaccount "payload-processing-e2e-migrate-3f6bf6aa" not found

openshift-ingress

kubelet

e2e-inf-a-033feb-openshift-default-68d977bdcb-4c597

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

openshift-ingress

multus

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a58460-ff8fb5f78-f6msr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a58460-6b9597c679-kct4t

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-cbb499

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-cbb499

openshift-ingress

replicaset-controller

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744

SuccessfulCreate

Created pod: e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

openshift-ingress

deployment-controller

e2e-shared-a-w2-cbb499-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-cbb499-openshift-default-74d67c6744 from 0 to 1

openshift-ingress

kubelet

e2e-inf-b-a58460-openshift-default-7fb6cb84f6-qqm2q

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cbb499-66f5446547

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-cbb499

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-cbb499-66f5446547

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-cbb499-66f5446547-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cbb499: serviceaccount "payload-processing-e2e-shared-a-w2-cbb499" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-cbb499

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-cbb499-66f5446547 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-cbb499: serviceaccount "payload-processing-e2e-shared-a-w2-cbb499" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-3f6bf6aa-77dd7f9bb-krzlw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-3f6bf6aa-7bf779f9cd-m5scq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-3f6bf6aa-gw-openshift-default-89f8bc9b-8wlb7

Killing

Stopping container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-migrate-3f6bf6aa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-migrate-3f6bf6aa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-migrate-3f6bf6aa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 849240e5-3199-4561-b896-2f4252bea551, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

e2e-ait-60623346-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-60623346-openshift-default-74b46659c6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-60623346-openshift-default-74b46659c6

SuccessfulCreate

Created pod: e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

openshift-ingress

gateway_labeler_controller

e2e-ait-60623346

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-60623346

openshift-ingress

multus

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-60623346

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-60623346-7bc746c65f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-60623346

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-60623346-7dd49cfbc4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-60623346-7bc746c65f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-60623346-7bc746c65f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-60623346: serviceaccount "payload-processing-e2e-ait-60623346" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-60623346-7bc746c65f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

Created

Created container: payload-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-60623346: serviceaccount "payload-processing-e2e-ait-60623346" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-c0ec73

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-c0ec73

openshift-ingress

multus

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-shared-b-w2-c0ec73-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86

SuccessfulCreate

Created pod: e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

Unhealthy

Startup probe failed: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

ProbeError

Startup probe error: Get "http://10.134.0.65:15021/healthz/ready": dial tcp 10.134.0.65:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-c0ec73

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c0ec73: serviceaccount "payload-processing-e2e-shared-b-w2-c0ec73" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-c0ec73: serviceaccount "payload-processing-e2e-shared-b-w2-c0ec73" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-c0ec73

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-processing-e2e-ait-60623346-7bc746c65f-j2ck5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-60623346-7dd49cfbc4-h4gjm

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-derive-74a27a74-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-74a27a74-openshift-default-ff859598d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-74a27a74

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-74a27a74

openshift-ingress

replicaset-controller

e2e-derive-74a27a74-openshift-default-ff859598d

SuccessfulCreate

Created pod: e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

openshift-ingress

kubelet

e2e-ait-60623346-openshift-default-74b46659c6-ttl2k

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

openshift-ingress

multus

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-74a27a74

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-74a27a74: serviceaccount "payload-processing-e2e-derive-74a27a74" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-74a27a74

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-74a27a74-6d9dc4dbbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf

SuccessfulCreate

Created pod: payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf

FailedCreate

Error creating: pods "payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-74a27a74: serviceaccount "payload-processing-e2e-derive-74a27a74" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-74a27a74-6d9dc4dbbf-zg26m

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-74a27a74-7f4bb45b66-dxr5s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (e2e-derive-74a27a74-openshift-default-dockercfg-dp6sf); attempting to pull the image may not succeed.

openshift-ingress

kubelet

e2e-derive-74a27a74-openshift-default-ff859598d-56dv9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w0-482177-5469cc445d-d7r55

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-worker-w0-482177-75756ff869-sjdhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-worker-w0-482177-openshift-default-6b76b97566-zz7c7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-mt-61dff065-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-61dff065-openshift-default-7f6f64799b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-61dff065-openshift-default-7f6f64799b

SuccessfulCreate

Created pod: e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

openshift-ingress

gateway_labeler_controller

e2e-mt-61dff065

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-61dff065

openshift-ingress

multus

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-61dff065-7f4fb559fc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-61dff065-7f4fb559fc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-61dff065: serviceaccount "payload-processing-e2e-mt-61dff065" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-61dff065-7f4fb559fc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

openshift-ingress

deployment-controller

payload-processing-e2e-mt-61dff065

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-61dff065-7f4fb559fc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-61dff065

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-61dff065-687c64f7cd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-61dff065-687c64f7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-61dff065-687c64f7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-61dff065-687c64f7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-61dff065: serviceaccount "payload-processing-e2e-mt-61dff065" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-61dff065

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-61dff065: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-61dff065": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-61dff065, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: caf7dbfa-a2c8-49b9-8ef6-a61a293fef14, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-61dff065-687c64f7cd-qsnjs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-61dff065-7f4fb559fc-ptb86

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-61dff065-openshift-default-7f6f64799b-4cc84

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-shared-a-w1-4bc0fb

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-a-w1-4bc0fb-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-a-w1-4bc0fb-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w1-4bc0fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w1-4bc0fb

openshift-ingress

deployment-controller

e2e-shared-a-w1-4bc0fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d

SuccessfulCreate

Created pod: e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w1-4bc0fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w1-4bc0fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-4bc0fb: serviceaccount "payload-processing-e2e-shared-a-w1-4bc0fb" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w1-4bc0fb: serviceaccount "payload-processing-e2e-shared-a-w1-4bc0fb" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-worker-w3-d0c9f2-7699d77785-z7vsl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-worker-w3-d0c9f2-78c7c6885d-hktrv

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w1-0d2655

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w1-0d2655

openshift-ingress

deployment-controller

e2e-shared-b-w1-0d2655-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4

SuccessfulCreate

Created pod: e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

openshift-ingress

kubelet

e2e-worker-w3-d0c9f2-openshift-default-849fbf46c8-mb9mb

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655: serviceaccount "payload-processing-e2e-shared-b-w1-0d2655" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w1-0d2655: serviceaccount "payload-processing-e2e-shared-b-w1-0d2655" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w1-0d2655

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w1-0d2655-575888b5b9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w1-0d2655

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-3b6e6489-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-3b6e6489-openshift-default-bdc7b7544 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-3b6e6489

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-3b6e6489

openshift-ingress

replicaset-controller

e2e-mt-3b6e6489-openshift-default-bdc7b7544

SuccessfulCreate

Created pod: e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

openshift-ingress

multus

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-3b6e6489

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-3b6e6489-6d9c69865 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3b6e6489: serviceaccount "payload-processing-e2e-mt-3b6e6489" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3b6e6489-6d9c69865

SuccessfulCreate

Created pod: payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

openshift-ingress

multus

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-3b6e6489-6d9c69865

FailedCreate

Error creating: pods "payload-processing-e2e-mt-3b6e6489-6d9c69865-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-3b6e6489: serviceaccount "payload-processing-e2e-mt-3b6e6489" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-3b6e6489

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr
(x2)

openshift-ingress

kubelet

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-3b6e6489-85cd45c59d-7gwsr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-3b6e6489-6d9c69865-swtqx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-3b6e6489

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-3b6e6489: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-3b6e6489": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-3b6e6489, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c6047bc3-b564-4e60-b319-cec0cbe221da, UID in object meta:

openshift-ingress

kubelet

e2e-mt-3b6e6489-openshift-default-bdc7b7544-8x7l8

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-8d230b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-8d230b

openshift-ingress

deployment-controller

e2e-ipp-a-8d230b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-8d230b-openshift-default-69478b486d from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-8d230b-openshift-default-69478b486d

SuccessfulCreate

Created pod: e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

openshift-ingress

multus

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6

SuccessfulCreate

Created pod: e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

openshift-ingress

gateway_labeler_controller

e2e-api-a-7d0959

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-7d0959

openshift-ingress

deployment-controller

e2e-api-a-7d0959-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-7d0959-openshift-default-6cc9b9ddf6 from 0 to 1

openshift-ingress

multus

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8d230b-c9484646

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-8d230b-c9484646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8d230b: serviceaccount "payload-processing-e2e-ipp-a-8d230b" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-8d230b-c9484646

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-8d230b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-8d230b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-8d230b-c9484646 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-8d230b: serviceaccount "payload-processing-e2e-ipp-a-8d230b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

AddedInterface

Add eth0 [10.133.0.82/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7d0959-68c54695c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-7d0959-68c54695c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-7d0959-68c54695c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7d0959: serviceaccount "payload-processing-e2e-api-a-7d0959" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7d0959-58f8bfc4d7

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-7d0959-58f8bfc4d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-7d0959: serviceaccount "payload-processing-e2e-api-a-7d0959" not found

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-7d0959

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-7d0959-58f8bfc4d7 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-7d0959

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-7d0959-68c54695c8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-7d0959-58f8bfc4d7

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

AddedInterface

Add eth0 [10.133.0.83/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

e2e-ipp-b-a42101-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a42101-openshift-default-64975f9d58 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a42101-openshift-default-64975f9d58

SuccessfulCreate

Created pod: e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a42101

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a42101

openshift-ingress

multus

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

ProbeError

Startup probe error: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

ProbeError

Startup probe error: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

Unhealthy

Startup probe failed: Get "http://10.134.0.82:15021/healthz/ready": dial tcp 10.134.0.82:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

Unhealthy

Startup probe failed: Get "http://10.133.0.81:15021/healthz/ready": dial tcp 10.133.0.81:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a42101

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a42101-5648d454c7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a42101-5648d454c7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a42101-5648d454c7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a42101-5648d454c7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a42101: serviceaccount "payload-processing-e2e-ipp-b-a42101" not found

openshift-ingress

gateway_labeler_controller

e2e-api-b-4e1413

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-4e1413
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a42101: serviceaccount "payload-processing-e2e-ipp-b-a42101" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

openshift-ingress

replicaset-controller

e2e-api-b-4e1413-openshift-default-d485ff5f8

SuccessfulCreate

Created pod: e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a42101

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b from 0 to 1

openshift-ingress

deployment-controller

e2e-api-b-4e1413-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-4e1413-openshift-default-d485ff5f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5

Started

Started container payload-processing

openshift-ingress

multus

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

AddedInterface

Add eth0 [10.134.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-4e1413

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4e1413-69564c5dfc

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-4e1413-69564c5dfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4e1413: serviceaccount "payload-processing-e2e-api-b-4e1413" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-4e1413: serviceaccount "payload-processing-e2e-api-b-4e1413" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-4e1413

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-4e1413-69564c5dfc from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-4e1413-69564c5dfc

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

openshift-ingress

multus

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

ProbeError

Startup probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Unhealthy

Startup probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Unhealthy

Startup probe failed: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

ProbeError

Startup probe error: Get "http://10.134.0.86:15021/healthz/ready": dial tcp 10.134.0.86:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-7d0959-68c54695c8-bqb7t

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-7d0959-58f8bfc4d7-bqznw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-7d0959-openshift-default-6cc9b9ddf6-z9v42

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

AddedInterface

Add eth0 [10.134.0.89/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688

SuccessfulCreate

Created pod: e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

openshift-ingress

deployment-controller

e2e-ipp-cleanup-f73a36-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-f73a36-openshift-default-7568f55688 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-f73a36

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-f73a36

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

Unhealthy

Readiness probe failed: dial tcp 10.133.0.86:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-b-4e1413-69564c5dfc-h2bz7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-4e1413-7dc56cb5c8-dv2s4

Unhealthy

Readiness probe failed: dial tcp 10.133.0.85:9004: connect: connection refused
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36: serviceaccount "payload-processing-e2e-ipp-cleanup-f73a36" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-f73a36

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-f73a36

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-f73a36: serviceaccount "payload-processing-e2e-ipp-cleanup-f73a36" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

AddedInterface

Add eth0 [10.133.0.90/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

AddedInterface

Add eth0 [10.133.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-4e1413-openshift-default-d485ff5f8-lv6vb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w1-4bc0fb-68cfb59b4b-wftkw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w1-4bc0fb-59475f7f7c-jmljt

Killing

Stopping container payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w1-4bc0fb-openshift-default-6d8b8fc65d-hktxb

Killing

Stopping container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

Unhealthy

Startup probe failed: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

ProbeError

Startup probe error: Get "http://10.134.0.89:15021/healthz/ready": dial tcp 10.134.0.89:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-f73a36-58c64c5bcd-p5vws

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-f73a36-64c867f7f-5r4jq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w1-0d2655-76cd8f4d9d-htct8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w1-0d2655-575888b5b9-7t6dn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-f73a36-openshift-default-7568f55688-vfdn7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w1-0d2655-openshift-default-8d864fbc4-bflcj

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-8d230b-5c8bf9cb4c-ctjr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-8d230b-c9484646-xhd89

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-8d230b-openshift-default-69478b486d-m757h

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a42101-5648d454c7-ctpr5

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a42101-7ffd868b8b-tgdbf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

ProbeError

Readiness probe error: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ipp-b-a42101-openshift-default-64975f9d58-m2ps8

Unhealthy

Readiness probe failed: Get "http://10.134.0.85:15021/healthz/ready": dial tcp 10.134.0.85:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-cbb499-66f5446547-fx2z7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-cbb499-6dc9d464c4-t8b5z

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-cbb499-openshift-default-74d67c6744-dbfrr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-c0ec73-96dcdfbdf-hhgkd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-c0ec73-7788cdf566-vqjrj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-c0ec73-openshift-default-b9fdc4d86-m5n9q

Killing

Stopping container istio-proxy
(x22)

openshift-ingress

kubelet

payload-processing-5d7dbbd56b-4455c

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-kkbcm); attempting to pull the image may not succeed.
(x22)

openshift-ingress

kubelet

payload-pre-processing-6cd864bc95-st4pq

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (payload-processing-dockercfg-kkbcm); attempting to pull the image may not succeed.