Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8 to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2 to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv to ip-10-0-128-63.ec2.internal

openshift-ingress

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Scheduled

Successfully assigned openshift-ingress/e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Scheduled

Successfully assigned openshift-ingress/e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2 to ip-10-0-136-3.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4 to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc to ip-10-0-131-84.ec2.internal

openshift-ingress

kube-auth-proxy-5b977b55fb-krqn2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b977b55fb-krqn2 to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-611042-b989f997-k6lrt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-611042-b989f997-k6lrt to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv to ip-10-0-128-63.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wk6hz to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc to ip-10-0-128-63.ec2.internal

openshift-ingress

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-d4wsh

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-d4wsh to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5 to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-kr5xx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-kr5xx to ip-10-0-136-3.ec2.internal

openshift-ingress

router-default-868d865496-l5lhw

Scheduled

Successfully assigned openshift-ingress/router-default-868d865496-l5lhw to ip-10-0-131-84.ec2.internal

openshift-ingress

router-default-868d865496-l5lhw

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9 to ip-10-0-131-84.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-6rllt

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-6rllt to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f799c427-68d687f597-8swvr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f799c427-68d687f597-8swvr to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

Scheduled

Successfully assigned openshift-ingress/e2e-autores-3f5660-openshift-default-58f9996558-lztj9 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4 to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl to ip-10-0-128-63.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-f56qm

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-f56qm to ip-10-0-128-63.ec2.internal

openshift-ingress

kube-auth-proxy-5b977b55fb-l74k5

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-5b977b55fb-l74k5 to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s to ip-10-0-131-84.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj to ip-10-0-136-3.ec2.internal

openshift-ingress

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg to ip-10-0-128-63.ec2.internal

openshift-ingress

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

Scheduled

Successfully assigned openshift-ingress/e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4 to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2 to ip-10-0-131-84.ec2.internal

openshift-ingress

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

Scheduled

Successfully assigned openshift-ingress/e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j to ip-10-0-128-63.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr to ip-10-0-136-3.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj to ip-10-0-136-3.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-868d865496 from 0 to 1
(x12)

openshift-ingress

replicaset-controller

router-default-868d865496

FailedCreate

Error creating: pods "router-default-868d865496-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-868d865496

FailedCreate

Error creating: pods "router-default-868d865496-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-868d865496

SuccessfulCreate

Created pod: router-default-868d865496-l5lhw
(x6)

openshift-ingress

kubelet

router-default-868d865496-l5lhw

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-868d865496-l5lhw

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-868d865496-l5lhw

Created

Created container: router

openshift-ingress

kubelet

router-default-868d865496-l5lhw

Started

Started container router

openshift-ingress

kubelet

router-default-868d865496-l5lhw

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

multus

router-default-868d865496-l5lhw

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-5b977b55fb

FailedCreate

Error creating: pods "kube-auth-proxy-5b977b55fb-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-5b977b55fb from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-5b977b55fb

SuccessfulCreate

Created pod: kube-auth-proxy-5b977b55fb-krqn2

openshift-ingress

replicaset-controller

kube-auth-proxy-5b977b55fb

SuccessfulCreate

Created pod: kube-auth-proxy-5b977b55fb-l74k5

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-krqn2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-5b977b55fb-l74k5

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-5b977b55fb-krqn2

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-l74k5

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-6rllt

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-l74k5

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.711s (2.711s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-krqn2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-krqn2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.625s (2.625s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-krqn2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-l74k5

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-5b977b55fb-l74k5

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-6rllt

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 10.671s (10.671s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

Created

Created container: discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

AddedInterface

Add eth0 [10.132.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.938s (2.938s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-f56qm

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-8sh5g

Started

Started container istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-rmwnm" : failed to sync configmap cache: timed out waiting for the condition

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

FailedMount

MountVolume.SetUp failed for volume "cacerts" : failed to sync secret cache: timed out waiting for the condition

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

FailedMount

MountVolume.SetUp failed for volume "istio-csr-dns-cert" : failed to sync secret cache: timed out waiting for the condition

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

FailedMount

MountVolume.SetUp failed for volume "istio-kubeconfig" : failed to sync secret cache: timed out waiting for the condition

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-f56qm

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.271s (2.271s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-f56qm

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-6rllt

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-6rllt

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-wk6hz

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-kr5xx

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-d4wsh
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kr5xx

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-kr5xx

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-d4wsh

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4wsh

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kr5xx

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.816s (1.816s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kr5xx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-kr5xx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4wsh

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.499s (3.499s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4wsh

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-d4wsh

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

Unhealthy

Startup probe failed: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-wk6hz

ProbeError

Startup probe error: Get "http://10.132.0.34:15021/healthz/ready": dial tcp 10.132.0.34:15021: connect: connection refused body:

openshift-ingress

multus

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9fa102

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9fa102

openshift-ingress

replicaset-controller

e2e-inf-a-9fa102-openshift-default-d68b4cf5b

SuccessfulCreate

Created pod: e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

openshift-ingress

deployment-controller

e2e-inf-a-9fa102-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9fa102-openshift-default-d68b4cf5b from 0 to 1

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 5.317s (5.317s including waiting). Image size: 181318953 bytes.

openshift-ingress

replicaset-controller

e2e-ait-26ca81aa-openshift-default-9486b87c8

SuccessfulCreate

Created pod: e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

openshift-ingress

deployment-controller

e2e-ait-26ca81aa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-26ca81aa-openshift-default-9486b87c8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-26ca81aa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-26ca81aa

openshift-ingress

gateway_labeler_controller

e2e-autores-3f5660

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-3f5660

openshift-ingress

deployment-controller

e2e-autores-3f5660-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-3f5660-openshift-default-58f9996558 from 0 to 1

openshift-ingress

multus

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-3f5660-openshift-default-58f9996558

SuccessfulCreate

Created pod: e2e-autores-3f5660-openshift-default-58f9996558-lztj9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9fa102: serviceaccount "payload-processing-e2e-inf-a-9fa102" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9fa102

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9fa102-7f49c6bcf9 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9fa102

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9fa102: serviceaccount "payload-processing-e2e-inf-a-9fa102" not found

openshift-ingress

multus

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-26ca81aa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-26ca81aa-556498d47d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ait-26ca81aa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-26ca81aa-84d75745d9 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-26ca81aa-84d75745d9

FailedCreate

Error creating: pods "payload-processing-e2e-ait-26ca81aa-84d75745d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-26ca81aa: serviceaccount "payload-processing-e2e-ait-26ca81aa" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-26ca81aa-556498d47d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-26ca81aa-556498d47d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-26ca81aa: serviceaccount "payload-processing-e2e-ait-26ca81aa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-26ca81aa-84d75745d9

SuccessfulCreate

Created pod: payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-26ca81aa-556498d47d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3f5660: serviceaccount "payload-processing-e2e-autores-3f5660" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-3f5660

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-3f5660-d8c54f7bf from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3f5660-d8c54f7bf

FailedCreate

Error creating: pods "payload-processing-e2e-autores-3f5660-d8c54f7bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-3f5660: serviceaccount "payload-processing-e2e-autores-3f5660" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-3f5660

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-3f5660-5db45ff8c8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-3f5660-d8c54f7bf

SuccessfulCreate

Created pod: payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Unhealthy

Readiness probe failed: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

ProbeError

Readiness probe error: Get "http://10.132.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

Created

Created container: istio-proxy

openshift-ingress

multus

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-inf-b-3f5460-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-3f5460-openshift-default-5cff8b869b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-b-3f5460

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-3f5460

openshift-ingress

replicaset-controller

e2e-inf-b-3f5460-openshift-default-5cff8b869b

SuccessfulCreate

Created pod: e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp
(x5)

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

ProbeError

Startup probe error: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Unhealthy

Startup probe failed: Get "http://10.133.0.35:15021/healthz/ready": dial tcp 10.133.0.35:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

ProbeError

Startup probe error: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Unhealthy

Startup probe failed: Get "http://10.132.0.46:15021/healthz/ready": dial tcp 10.132.0.46:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-3f5460

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-3f5460-68bd4c8b7f from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3f5460: serviceaccount "payload-processing-e2e-inf-b-3f5460" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-3f5460: serviceaccount "payload-processing-e2e-inf-b-3f5460" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-3f5460

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-26ca81aa-556498d47d-p9h2c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-26ca81aa-84d75745d9-2dtnl

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-26ca81aa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-26ca81aa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-26ca81aa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: f00d6f24-6ce9-496f-98d3-83076d8c5c0c, UID in object meta:

openshift-ingress

kubelet

e2e-ait-26ca81aa-openshift-default-9486b87c8-szz55

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-f85216b6-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-f85216b6-gw

openshift-ingress

multus

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-migrate-f85216b6-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb

SuccessfulCreate

Created pod: e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f85216b6-89cc8ff78

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-f85216b6-89cc8ff78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f85216b6: serviceaccount "payload-processing-e2e-migrate-f85216b6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4
(x2)

openshift-ingress

kubelet

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-f85216b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-f85216b6-89cc8ff78 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-f85216b6-89cc8ff78

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-f85216b6: serviceaccount "payload-processing-e2e-migrate-f85216b6" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-f85216b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

Created

Created container: istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

ProbeError

Startup probe error: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

Unhealthy

Startup probe failed: Get "http://10.133.0.38:15021/healthz/ready": dial tcp 10.133.0.38:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-f85216b6-57886fdf4b-mhcz4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-migrate-f85216b6-89cc8ff78-t6g7m

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-d53e4343

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-d53e4343

openshift-ingress

deployment-controller

e2e-ait-d53e4343-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-d53e4343-openshift-default-6964f74cd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-d53e4343-openshift-default-6964f74cd

SuccessfulCreate

Created pod: e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

openshift-ingress

multus

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d53e4343-7fc9c55b4f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

openshift-ingress

deployment-controller

payload-processing-e2e-ait-d53e4343

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-d53e4343-7fc9c55b4f from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-d53e4343-7fc9c55b4f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-d53e4343-7fc9c55b4f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d53e4343: serviceaccount "payload-processing-e2e-ait-d53e4343" not found

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-f85216b6-gw-openshift-default-7d46d957cb-z9zqv

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-d53e4343

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-d53e4343-67b6f49f58 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-d53e4343: serviceaccount "payload-processing-e2e-ait-d53e4343" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-d53e4343-7fc9c55b4f-h7t9n

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-processing-e2e-ait-d53e4343

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-processing-e2e-ait-d53e4343: Operation cannot be fulfilled on endpoints "payload-processing-e2e-ait-d53e4343": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-processing-e2e-ait-d53e4343, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a1c2e5fc-9bda-4fb5-adcf-8e8263d890e5, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-d53e4343-67b6f49f58-n884s

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-3f5660-5db45ff8c8-zrkjj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-d53e4343-openshift-default-6964f74cd-9jfhv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-autores-3f5660-d8c54f7bf-qgc6c

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-derive-c586c514

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-c586c514

openshift-ingress

replicaset-controller

e2e-derive-c586c514-openshift-default-d8685f8b4

SuccessfulCreate

Created pod: e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

openshift-ingress

deployment-controller

e2e-derive-c586c514-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-c586c514-openshift-default-d8685f8b4 from 0 to 1

openshift-ingress

multus

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c586c514-88765858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-c586c514

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-c586c514-88765858 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-derive-c586c514

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-c586c514-68cf57b745 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c586c514-68cf57b745

FailedCreate

Error creating: pods "payload-processing-e2e-derive-c586c514-68cf57b745-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c586c514: serviceaccount "payload-processing-e2e-derive-c586c514" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-c586c514-88765858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-c586c514-88765858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-c586c514: serviceaccount "payload-processing-e2e-derive-c586c514" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-c586c514-68cf57b745

SuccessfulCreate

Created pod: payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

openshift-ingress

multus

payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-3c1adc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-3c1adc-openshift-default-595d747db4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-explicit-3c1adc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-3c1adc

openshift-ingress

kubelet

e2e-autores-3f5660-openshift-default-58f9996558-lztj9

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-explicit-3c1adc-openshift-default-595d747db4

SuccessfulCreate

Created pod: e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

openshift-ingress

multus

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-3c1adc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-3c1adc-d86f58d49 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-3c1adc-d86f58d49

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-3c1adc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

Started

Started container payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-3c1adc-d86f58d49

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-3c1adc-d86f58d49-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-3c1adc: serviceaccount "payload-processing-e2e-explicit-3c1adc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-3c1adc: serviceaccount "payload-processing-e2e-explicit-3c1adc" not found

openshift-ingress

kubelet

payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-derive-c586c514-68cf57b745-ndhl8

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-c586c514-88765858-5rd9j

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-c586c514-openshift-default-d8685f8b4-fvq4j

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Unhealthy

Startup probe failed: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

ProbeError

Startup probe error: Get "http://10.133.0.47:15021/healthz/ready": dial tcp 10.133.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-3c1adc-79b56f74c4-p2spc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-3c1adc-d86f58d49-5scwr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-f4bf9e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-f4bf9e

openshift-ingress

deployment-controller

e2e-noten-f4bf9e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-f4bf9e-openshift-default-864bb4bb84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-f4bf9e-openshift-default-864bb4bb84

SuccessfulCreate

Created pod: e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

openshift-ingress

kubelet

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-explicit-3c1adc-openshift-default-595d747db4-fz96s

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-noten-f4bf9e-openshift-default-864bb4bb84-l6g5k

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9fa102-7f49c6bcf9-ftwkb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9fa102-6944d8c8c4-kkln4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-9fa102-openshift-default-d68b4cf5b-4xpbg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-3f5460-6cc86db6f4-qkswh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-3f5460-68bd4c8b7f-lrzqc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-b-3f5460-openshift-default-5cff8b869b-q2vhp

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664

SuccessfulCreate

Created pod: e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

openshift-ingress

deployment-controller

e2e-shared-a-w3-1795dd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-1795dd-openshift-default-77fcb46664 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-1795dd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-1795dd

openshift-ingress

multus

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd: serviceaccount "payload-processing-e2e-shared-a-w3-1795dd" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-1795dd: serviceaccount "payload-processing-e2e-shared-a-w3-1795dd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-1795dd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-1795dd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-mt-f799c427-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f799c427-openshift-default-7cb945c66d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-f799c427

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f799c427

openshift-ingress

replicaset-controller

e2e-mt-f799c427-openshift-default-7cb945c66d

SuccessfulCreate

Created pod: e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

openshift-ingress

multus

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f799c427-68d687f597

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f799c427-68d687f597-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f799c427: serviceaccount "payload-processing-e2e-mt-f799c427" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f799c427

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f799c427-5b6c5859d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f799c427

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f799c427-68d687f597 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f799c427-5b6c5859d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f799c427-5b6c5859d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f799c427: serviceaccount "payload-processing-e2e-mt-f799c427" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f799c427-5b6c5859d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-f799c427-68d687f597-8swvr

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-f799c427-68d687f597-8swvr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-f799c427-68d687f597-8swvr

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-mt-f799c427-68d687f597-8swvr

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f799c427-68d687f597

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f799c427-68d687f597-8swvr
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-3973bf

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-3973bf

openshift-ingress

replicaset-controller

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6

SuccessfulCreate

Created pod: e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

openshift-ingress

deployment-controller

e2e-shared-b-w3-3973bf-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-3973bf

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf: serviceaccount "payload-processing-e2e-shared-b-w3-3973bf" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-3973bf

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-3973bf-85c5575f57 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-3973bf: serviceaccount "payload-processing-e2e-shared-b-w3-3973bf" not found

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": read tcp 10.133.0.2:54758->10.133.0.56:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": read tcp 10.133.0.2:54758->10.133.0.56:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-f799c427-68d687f597-8swvr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f799c427-5b6c5859d-6l7sm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-f799c427-openshift-default-7cb945c66d-r87rw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-202015

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-202015

openshift-ingress

deployment-controller

e2e-shared-a-w2-202015-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-202015-openshift-default-5b8687dd4b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b

SuccessfulCreate

Created pod: e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

openshift-ingress

multus

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-202015: serviceaccount "payload-processing-e2e-shared-a-w2-202015" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-202015

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-202015

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-202015-67cb789677 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-202015-67cb789677

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-202015-67cb789677

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-202015-67cb789677-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-202015: serviceaccount "payload-processing-e2e-shared-a-w2-202015" not found

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-43ab35

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-43ab35

openshift-ingress

replicaset-controller

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d

SuccessfulCreate

Created pod: e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

openshift-ingress

deployment-controller

e2e-shared-b-w2-43ab35-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-43ab35

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35: serviceaccount "payload-processing-e2e-shared-b-w2-43ab35" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-43ab35: serviceaccount "payload-processing-e2e-shared-b-w2-43ab35" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-43ab35

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

AddedInterface

Add eth0 [10.134.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-mt-4170e7d8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-4170e7d8-openshift-default-57b6b4c448 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-4170e7d8-openshift-default-57b6b4c448

SuccessfulCreate

Created pod: e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

openshift-ingress

gateway_labeler_controller

e2e-mt-4170e7d8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-4170e7d8

openshift-ingress

multus

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4170e7d8-577ff7c6cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-4170e7d8-577ff7c6cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-4170e7d8-577ff7c6cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4170e7d8: serviceaccount "payload-processing-e2e-mt-4170e7d8" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-4170e7d8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-4170e7d8: serviceaccount "payload-processing-e2e-mt-4170e7d8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-4170e7d8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-4170e7d8-577ff7c6cc from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

AddedInterface

Add eth0 [10.134.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-4170e7d8-9f85f9b6b-qd4j2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-4170e7d8-577ff7c6cc-fpqxq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-4170e7d8-openshift-default-57b6b4c448-crbqk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-b36e3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-b36e3a-openshift-default-69f8d89f4d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-b36e3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-b36e3a

openshift-ingress

multus

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-api-a-b36e3a-openshift-default-69f8d89f4d

SuccessfulCreate

Created pod: e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-b36e3a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-b36e3a-56647bf698 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b36e3a-56647bf698

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-b36e3a-56647bf698-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b36e3a: serviceaccount "payload-processing-e2e-api-a-b36e3a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-b36e3a-56647bf698

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-b36e3a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-b36e3a-5fdf7d9759 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b36e3a-5fdf7d9759

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-b36e3a-5fdf7d9759

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-b36e3a-5fdf7d9759-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-b36e3a: serviceaccount "payload-processing-e2e-api-a-b36e3a" not found

openshift-ingress

multus

payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

AddedInterface

Add eth0 [10.134.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-b-611042

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-611042

openshift-ingress

replicaset-controller

e2e-api-b-611042-openshift-default-68cfffdf5d

SuccessfulCreate

Created pod: e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

openshift-ingress

deployment-controller

e2e-api-b-611042-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-611042-openshift-default-68cfffdf5d from 0 to 1

openshift-ingress

multus

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-611042

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-611042-b989f997 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-611042-b989f997

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-611042-b989f997-k6lrt

openshift-ingress

multus

payload-processing-e2e-api-b-611042-b989f997-k6lrt

AddedInterface

Add eth0 [10.134.0.77/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-611042-b989f997

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-611042-b989f997-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-611042: serviceaccount "payload-processing-e2e-api-b-611042" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-611042-b989f997-k6lrt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-611042-b989f997-k6lrt

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-611042-b989f997-k6lrt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-611042

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-611042-6df9455858 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-611042-6df9455858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-611042-6df9455858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-611042-6df9455858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-611042: serviceaccount "payload-processing-e2e-api-b-611042" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr

AddedInterface

Add eth0 [10.134.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

Unhealthy

Startup probe failed: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

ProbeError

Startup probe error: Get "http://10.132.0.70:15021/healthz/ready": dial tcp 10.132.0.70:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-api-a-b36e3a-5fdf7d9759-58866

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-b36e3a-56647bf698-pwqpj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-b36e3a-openshift-default-69f8d89f4d-ff58t

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-611042-6df9455858-xrsmr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-611042-b989f997-k6lrt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-611042-openshift-default-68cfffdf5d-zz2n9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-202015-5b765cbdb6-bg2w5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-202015-67cb789677-9xlqr

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-202015

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-202015": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-202015, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: e5a80520-19be-4fc5-b166-432a376c824f, UID in object meta:

openshift-ingress

replicaset-controller

e2e-ipp-a-9765ce-openshift-default-77469968b4

SuccessfulCreate

Created pod: e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

openshift-ingress

deployment-controller

e2e-ipp-a-9765ce-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-9765ce-openshift-default-77469968b4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-9765ce

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-9765ce

openshift-ingress

multus

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-9765ce

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9765ce: serviceaccount "payload-processing-e2e-ipp-a-9765ce" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

AddedInterface

Add eth0 [10.134.0.80/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr

AddedInterface

Add eth0 [10.134.0.81/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-9765ce

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-9765ce-556d5b78c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9765ce-556d5b78c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-9765ce-556d5b78c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-9765ce-556d5b78c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-9765ce: serviceaccount "payload-processing-e2e-ipp-a-9765ce" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w2-202015-openshift-default-5b8687dd4b-5x8lc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-43ab35-cf6f6f9f9-ctstm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-43ab35-5cd5d44494-hp6jv

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

ProbeError

Readiness probe error: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Unhealthy

Readiness probe failed: Get "http://10.132.0.71:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w2-43ab35-openshift-default-5f4b69984d-67rlv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Unhealthy

Startup probe failed: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

ProbeError

Startup probe error: Get "http://10.132.0.71:15021/healthz/ready": dial tcp 10.132.0.71:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-b-fac82d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-fac82d-openshift-default-665c9458bd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-fac82d-openshift-default-665c9458bd

SuccessfulCreate

Created pod: e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-fac82d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-fac82d

openshift-ingress

multus

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fac82d-56475f888c

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fac82d: serviceaccount "payload-processing-e2e-ipp-b-fac82d" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-fac82d-56475f888c

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-fac82d-56475f888c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-fac82d: serviceaccount "payload-processing-e2e-ipp-b-fac82d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-fac82d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-fac82d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-fac82d-56475f888c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb

AddedInterface

Add eth0 [10.134.0.82/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-ipp-cleanup-dad805-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596

SuccessfulCreate

Created pod: e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-dad805

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-dad805

openshift-ingress

multus

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805: serviceaccount "payload-processing-e2e-ipp-cleanup-dad805" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-dad805

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-dad805-664d7d9747 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-dad805: serviceaccount "payload-processing-e2e-ipp-cleanup-dad805" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-dad805

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-dad805-664d7d9747-g7hnr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-dad805-77b458d5db-xkqxn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-dad805-openshift-default-7b88c6d596-wqfpc

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-9765ce-556d5b78c-56bcr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-9765ce-56cd8784c8-sc8c2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-9765ce-openshift-default-77469968b4-xzwt4

Killing

Stopping container istio-proxy

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-fac82d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-fac82d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-fac82d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a825d92d-9097-4d0e-9932-6f60bf9ca8a8, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-fac82d-956f6fb58-wgmpx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-fac82d-56475f888c-fcngb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-b-fac82d-openshift-default-665c9458bd-hd8bh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-1795dd-745d5c674b-57wh4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-1795dd-5cdccb7c99-ql2j9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-a-w3-1795dd-openshift-default-77fcb46664-dpqxl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-3973bf-85c5575f57-jzdm9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-3973bf-5b77cb7954-hx8x2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-3973bf-openshift-default-65c9dc67b6-qqw7v

Killing

Stopping container istio-proxy