Time Namespace Component RelatedObject Reason Message

openshift-ingress

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6 to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-dc3099-69445df59-md827

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-dc3099-69445df59-md827 to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7 to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

Scheduled

Successfully assigned openshift-ingress/e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52 to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-ab334d49-799789bf75-vjljf to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Scheduled

Successfully assigned openshift-ingress/e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

Scheduled

Successfully assigned openshift-ingress/e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-g7qxr

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-g7qxr to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5 to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2 to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h to ip-10-0-134-62.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz to ip-10-0-129-13.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-vrdgd

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-vrdgd to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Scheduled

Successfully assigned openshift-ingress/e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82 to ip-10-0-136-121.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-k76qg

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-k76qg to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn to ip-10-0-136-121.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44 to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-pvw2q

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-pvw2q to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs to ip-10-0-136-121.ec2.internal

openshift-ingress

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k to ip-10-0-136-121.ec2.internal

openshift-ingress

kube-auth-proxy-6bcf9fffd5-g8tlr

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6bcf9fffd5-g8tlr to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g to ip-10-0-134-62.ec2.internal

openshift-ingress

router-default-6564b7c66d-qpftd

Scheduled

Successfully assigned openshift-ingress/router-default-6564b7c66d-qpftd to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

Scheduled

Successfully assigned openshift-ingress/e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp to ip-10-0-134-62.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-nrds4

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nrds4 to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b to ip-10-0-134-62.ec2.internal

openshift-ingress

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2 to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9 to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t to ip-10-0-129-13.ec2.internal

openshift-ingress

kube-auth-proxy-6bcf9fffd5-7xzlb

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-6bcf9fffd5-7xzlb to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9 to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Scheduled

Successfully assigned openshift-ingress/e2e-autores-80db9b-openshift-default-86f7654d7b-srpww to ip-10-0-129-13.ec2.internal

openshift-ingress

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh to ip-10-0-129-13.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4 to ip-10-0-134-62.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc to ip-10-0-134-62.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6564b7c66d from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-6564b7c66d

FailedCreate

Error creating: pods "router-default-6564b7c66d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x17)

openshift-ingress

replicaset-controller

router-default-6564b7c66d

FailedCreate

Error creating: pods "router-default-6564b7c66d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6564b7c66d

SuccessfulCreate

Created pod: router-default-6564b7c66d-qpftd
(x5)

openshift-ingress

kubelet

router-default-6564b7c66d-qpftd

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-6564b7c66d-qpftd

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6564b7c66d-qpftd

Created

Created container: router

openshift-ingress

multus

router-default-6564b7c66d-qpftd

AddedInterface

Add eth0 [10.133.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6564b7c66d-qpftd

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-6564b7c66d-qpftd

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-6bcf9fffd5 from 0 to 2
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-6bcf9fffd5

FailedCreate

Error creating: pods "kube-auth-proxy-6bcf9fffd5-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-6bcf9fffd5

SuccessfulCreate

Created pod: kube-auth-proxy-6bcf9fffd5-g8tlr

openshift-ingress

multus

kube-auth-proxy-6bcf9fffd5-7xzlb

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-6bcf9fffd5-g8tlr

AddedInterface

Add eth0 [10.133.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-g8tlr

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-7xzlb

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

replicaset-controller

kube-auth-proxy-6bcf9fffd5

SuccessfulCreate

Created pod: kube-auth-proxy-6bcf9fffd5-7xzlb

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-k76qg

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-7xzlb

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.017s (3.017s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-7xzlb

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-g8tlr

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-g8tlr

Created

Created container: kube-auth-proxy

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-k76qg

AddedInterface

Add eth0 [10.133.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-g8tlr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.957s (2.957s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-6bcf9fffd5-7xzlb

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.844s (2.844s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-vrdgd

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-vrdgd

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vrdgd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vrdgd

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vrdgd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.266s (2.267s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

Created

Created container: istio-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vrdgd

Started

Started container discovery

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4rdwk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.574s (2.574s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vrdgd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-vrdgd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-k76qg

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-k76qg
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-nrds4

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-nrds4

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-pvw2q

openshift-ingress

multus

payload-processing-5b54b7fbb7-g7qxr

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g7qxr

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-g7qxr
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pvw2q

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-pvw2q

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g7qxr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g7qxr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-g7qxr

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.875s (1.875s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pvw2q

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 3.578s (3.578s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pvw2q

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-pvw2q

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nrds4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nrds4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nrds4

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nrds4

Unhealthy

Startup probe failed: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-nrds4

ProbeError

Startup probe error: Get "http://10.133.0.32:15021/healthz/ready": dial tcp 10.133.0.32:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-a-9a54ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-9a54ea

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-9a54ea

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-9a54ea-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-9a54ea-authn-ssl" already exists

openshift-ingress

deployment-controller

e2e-inf-a-9a54ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-9a54ea-openshift-default-c774f7d5b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-9a54ea-openshift-default-c774f7d5b

SuccessfulCreate

Created pod: e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

openshift-ingress

multus

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-9a54ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-9a54ea-949df64d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-9a54ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-9a54ea-688b57cb47 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9a54ea: serviceaccount "payload-processing-e2e-inf-a-9a54ea" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9a54ea-688b57cb47

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-9a54ea-688b57cb47-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-9a54ea: serviceaccount "payload-processing-e2e-inf-a-9a54ea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-9a54ea-688b57cb47

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

openshift-ingress

multus

payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

e2e-ait-ab334d49-openshift-default-67c8489f76

SuccessfulCreate

Created pod: e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

openshift-ingress

deployment-controller

e2e-ait-ab334d49-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-ab334d49-openshift-default-67c8489f76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-ab334d49

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-ab334d49

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-80db9b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-80db9b-openshift-default-86f7654d7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-80db9b-openshift-default-86f7654d7b

SuccessfulCreate

Created pod: e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

openshift-ingress

gateway_labeler_controller

e2e-autores-80db9b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-80db9b

openshift-ingress

multus

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.277s (3.277s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.739s (2.739s including waiting). Image size: 181318953 bytes.
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ab334d49-799789bf75

FailedCreate

Error creating: pods "payload-processing-e2e-ait-ab334d49-799789bf75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ab334d49: serviceaccount "payload-processing-e2e-ait-ab334d49" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-ab334d49

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-ab334d49: serviceaccount "payload-processing-e2e-ait-ab334d49" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-ab334d49

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-ab334d49-799789bf75 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-ab334d49-799789bf75

SuccessfulCreate

Created pod: payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

openshift-ingress

multus

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-80db9b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-80db9b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-80db9b-5bbd7744c5 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-80db9b: serviceaccount "payload-processing-e2e-autores-80db9b" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-80db9b-5bbd7744c5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-80db9b-5bbd7744c5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-80db9b: serviceaccount "payload-processing-e2e-autores-80db9b" not found

openshift-ingress

multus

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-80db9b-5bbd7744c5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-b-98dad6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-98dad6

openshift-ingress

multus

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

AddedInterface

Add eth0 [10.134.0.25/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-inf-b-98dad6-openshift-default-79764cf5b

SuccessfulCreate

Created pod: e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

openshift-ingress

deployment-controller

e2e-inf-b-98dad6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-98dad6-openshift-default-79764cf5b from 0 to 1

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

ProbeError

Readiness probe error: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Unhealthy

Readiness probe failed: Get "http://10.132.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-98dad6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-98dad6-5764858bdc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-98dad6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-98dad6-5764858bdc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Started

Started container istio-proxy
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-98dad6-5764858bdc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-98dad6-5764858bdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-98dad6: serviceaccount "payload-processing-e2e-inf-b-98dad6" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-98dad6: serviceaccount "payload-processing-e2e-inf-b-98dad6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

ProbeError

Startup probe error: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Unhealthy

Startup probe failed: Get "http://10.132.0.57:15021/healthz/ready": dial tcp 10.132.0.57:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Unhealthy

Startup probe failed: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

ProbeError

Startup probe error: Get "http://10.134.0.22:15021/healthz/ready": dial tcp 10.134.0.22:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-ab334d49-799789bf75-vjljf

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-ab334d49-5d699d9c9d-9qc5g

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

ProbeError

Startup probe error: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

Unhealthy

Startup probe failed: Get "http://10.134.0.25:15021/healthz/ready": dial tcp 10.134.0.25:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-ab334d49-openshift-default-67c8489f76-cnhjt

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-migrate-e62fbb04-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e62fbb04-gw

openshift-ingress

multus

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6

SuccessfulCreate

Created pod: e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

openshift-ingress

deployment-controller

e2e-migrate-e62fbb04-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e62fbb04: serviceaccount "payload-processing-e2e-migrate-e62fbb04" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e62fbb04

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e62fbb04-7d5c96c9d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e62fbb04

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e62fbb04: serviceaccount "payload-processing-e2e-migrate-e62fbb04" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

ProbeError

Startup probe error: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Unhealthy

Startup probe failed: Get "http://10.134.0.27:15021/healthz/ready": dial tcp 10.134.0.27:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e62fbb04-7bd4b896f8-bcdjc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e62fbb04-7d5c96c9d-9nn7b

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-857dd97d-openshift-default-7b74fff956

SuccessfulCreate

Created pod: e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

openshift-ingress

gateway_labeler_controller

e2e-ait-857dd97d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-857dd97d

openshift-ingress

deployment-controller

e2e-ait-857dd97d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-857dd97d-openshift-default-7b74fff956 from 0 to 1

openshift-ingress

multus

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-migrate-e62fbb04-gw-openshift-default-77b86d7bf6-wvsxn

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

deployment-controller

payload-processing-e2e-ait-857dd97d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-857dd97d-585956dcbc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

openshift-ingress

multus

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-857dd97d-585956dcbc

FailedCreate

Error creating: pods "payload-processing-e2e-ait-857dd97d-585956dcbc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-857dd97d: serviceaccount "payload-processing-e2e-ait-857dd97d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-857dd97d-585956dcbc

SuccessfulCreate

Created pod: payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-857dd97d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-857dd97d: serviceaccount "payload-processing-e2e-ait-857dd97d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

ProbeError

Readiness probe error: Get "http://10.134.0.30:15021/healthz/ready": read tcp 10.134.0.2:43962->10.134.0.30:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Unhealthy

Readiness probe failed: Get "http://10.134.0.30:15021/healthz/ready": read tcp 10.134.0.2:43962->10.134.0.30:15021: read: connection reset by peer
(x6)

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

ProbeError

Startup probe error: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Unhealthy

Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ait-857dd97d-585956dcbc-5vq8t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-857dd97d-5fdb6dfb6-m5mgl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-857dd97d-openshift-default-7b74fff956-2ddjv

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-47d82e7b-openshift-default-6b497dfdd

SuccessfulCreate

Created pod: e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

openshift-ingress

gateway_labeler_controller

e2e-derive-47d82e7b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-47d82e7b

openshift-ingress

deployment-controller

e2e-derive-47d82e7b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-47d82e7b-openshift-default-6b497dfdd from 0 to 1

openshift-ingress

multus

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

openshift-ingress

deployment-controller

payload-processing-e2e-derive-47d82e7b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-47d82e7b-7b7d8c7489 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-47d82e7b-7b7d8c7489

SuccessfulCreate

Created pod: payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-47d82e7b-7b7d8c7489

FailedCreate

Error creating: pods "payload-processing-e2e-derive-47d82e7b-7b7d8c7489-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-47d82e7b: serviceaccount "payload-processing-e2e-derive-47d82e7b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-47d82e7b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-47d82e7b: serviceaccount "payload-processing-e2e-derive-47d82e7b" not found

openshift-ingress

multus

payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52

Created

Created container: payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-80db9b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-80db9b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-80db9b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-80db9b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 08630438-135e-40f7-a058-43c7a3238ba8, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-autores-80db9b-5bbd7744c5-pgm9l

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-80db9b-57bfb8dbdb-wx76m

Killing

Stopping container payload-pre-processing

openshift-ingress

deployment-controller

e2e-explicit-0066f8-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-0066f8-openshift-default-6958f44c84 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-0066f8-openshift-default-6958f44c84

SuccessfulCreate

Created pod: e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

openshift-ingress

gateway_labeler_controller

e2e-explicit-0066f8

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-0066f8

openshift-ingress

kubelet

e2e-autores-80db9b-openshift-default-86f7654d7b-srpww

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

Started

Started container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0066f8-8688dcd98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-0066f8-8688dcd98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0066f8: serviceaccount "payload-processing-e2e-explicit-0066f8" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-0066f8

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-0066f8-7d49cf4857 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0066f8-7d49cf4857

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-0066f8

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-0066f8-8688dcd98 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-0066f8-8688dcd98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-0066f8-7d49cf4857

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-0066f8-7d49cf4857-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-0066f8: serviceaccount "payload-processing-e2e-explicit-0066f8" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-47d82e7b-7b7d8c7489-rhb52

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-47d82e7b-5bb9469d94-66klb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-47d82e7b-openshift-default-6b497dfdd-48tmp

Killing

Stopping container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

Unhealthy

Startup probe failed: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

ProbeError

Startup probe error: Get "http://10.134.0.34:15021/healthz/ready": dial tcp 10.134.0.34:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-0066f8-7d49cf4857-42qgb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-0066f8-8688dcd98-2fslq

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-noten-46ba3a-openshift-default-578bbf8498

SuccessfulCreate

Created pod: e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

openshift-ingress

kubelet

e2e-explicit-0066f8-openshift-default-6958f44c84-wxz9k

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-46ba3a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-46ba3a

openshift-ingress

deployment-controller

e2e-noten-46ba3a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-46ba3a-openshift-default-578bbf8498 from 0 to 1

openshift-ingress

kubelet

e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-46ba3a-openshift-default-578bbf8498-25lsj

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-mt-57783aa9-openshift-default-5b87668db4

SuccessfulCreate

Created pod: e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

openshift-ingress

gateway_labeler_controller

e2e-mt-57783aa9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-57783aa9

openshift-ingress

deployment-controller

e2e-mt-57783aa9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-57783aa9-openshift-default-5b87668db4 from 0 to 1

openshift-ingress

multus

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-57783aa9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-57783aa9-59df4d6594 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-57783aa9-59df4d6594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-57783aa9-59df4d6594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-57783aa9: serviceaccount "payload-processing-e2e-mt-57783aa9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-57783aa9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-57783aa9-7cb9ccd969 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-57783aa9-59df4d6594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-57783aa9-7cb9ccd969

FailedCreate

Error creating: pods "payload-processing-e2e-mt-57783aa9-7cb9ccd969-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-57783aa9: serviceaccount "payload-processing-e2e-mt-57783aa9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-57783aa9-7cb9ccd969

SuccessfulCreate

Created pod: payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

openshift-ingress

multus

payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-9a54ea-949df64d6-46bkb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-9a54ea-688b57cb47-qmq44

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-9a54ea-openshift-default-c774f7d5b-vnz9d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

ProbeError

Readiness probe error: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Unhealthy

Readiness probe failed: Get "http://10.134.0.39:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-98dad6-5764858bdc-dxsjs

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-98dad6

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-98dad6: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-98dad6": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-98dad6, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c68ec4dd-1dd0-4c7c-b399-79b88cba9256, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-98dad6-67b55d9bdb-qttlj

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Unhealthy

Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

ProbeError

Startup probe error: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-98dad6-openshift-default-79764cf5b-tlh8q

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874

SuccessfulCreate

Created pod: e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

openshift-ingress

deployment-controller

e2e-shared-a-w3-3d3cac-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-3d3cac

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-3d3cac

openshift-ingress

multus

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-3d3cac

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-3d3cac: serviceaccount "payload-processing-e2e-shared-a-w3-3d3cac" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-3d3cac

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-3d3cac: serviceaccount "payload-processing-e2e-shared-a-w3-3d3cac" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-57783aa9-7cb9ccd969-p2tbv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-57783aa9-59df4d6594-qv7lz

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Unhealthy

Readiness probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

ProbeError

Readiness probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-mt-57783aa9-openshift-default-5b87668db4-w5g82

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Unhealthy

Startup probe failed: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

ProbeError

Startup probe error: Get "http://10.133.0.59:15021/healthz/ready": dial tcp 10.133.0.59:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-shared-b-w3-8db5a7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-8db5a7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-8db5a7

openshift-ingress

replicaset-controller

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4

SuccessfulCreate

Created pod: e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-629537

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-629537
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8db5a7-db7789959

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-8db5a7-db7789959-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8db5a7: serviceaccount "payload-processing-e2e-shared-b-w3-8db5a7" not found

openshift-ingress

multus

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-8db5a7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-8db5a7-db7789959 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4

SuccessfulCreate

Created pod: e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-8db5a7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4 from 0 to 1

openshift-ingress

deployment-controller

e2e-shared-a-w2-629537-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-8db5a7-db7789959

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-8db5a7: serviceaccount "payload-processing-e2e-shared-b-w3-8db5a7" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-629537

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-629537

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-629537-744fbb9fd5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-629537: serviceaccount "payload-processing-e2e-shared-a-w2-629537" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-629537: serviceaccount "payload-processing-e2e-shared-a-w2-629537" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2

AddedInterface

Add eth0 [10.133.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

ProbeError

Readiness probe error: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Unhealthy

Readiness probe failed: Get "http://10.134.0.41:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

ProbeError

Readiness probe error: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Unhealthy

Readiness probe failed: Get "http://10.134.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Unhealthy

Startup probe failed: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

ProbeError

Startup probe error: Get "http://10.134.0.41:15021/healthz/ready": dial tcp 10.134.0.41:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-459158-openshift-default-898564cd4

SuccessfulCreate

Created pod: e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

openshift-ingress

deployment-controller

e2e-shared-b-w2-459158-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-459158-openshift-default-898564cd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-459158

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-459158

openshift-ingress

multus

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-459158: serviceaccount "payload-processing-e2e-shared-b-w2-459158" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-459158-b4c7dc955

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-459158-b4c7dc955-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-459158: serviceaccount "payload-processing-e2e-shared-b-w2-459158" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-459158-b4c7dc955

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-459158

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-459158

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-459158-b4c7dc955 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

AddedInterface

Add eth0 [10.132.0.78/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

Unhealthy

Startup probe failed: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

ProbeError

Startup probe error: Get "http://10.134.0.45:15021/healthz/ready": dial tcp 10.134.0.45:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-f8b5626b-openshift-default-6cd576db96

SuccessfulCreate

Created pod: e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

openshift-ingress

deployment-controller

e2e-mt-f8b5626b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-f8b5626b-openshift-default-6cd576db96 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-f8b5626b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-f8b5626b

openshift-ingress

GatewayAuthBootstrap

e2e-mt-f8b5626b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-mt-f8b5626b-authn-ssl: envoyfilters.networking.istio.io "e2e-mt-f8b5626b-authn-ssl" already exists

openshift-ingress

multus

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f8b5626b-66cd4f74f7

FailedCreate

Error creating: pods "payload-processing-e2e-mt-f8b5626b-66cd4f74f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f8b5626b: serviceaccount "payload-processing-e2e-mt-f8b5626b" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-f8b5626b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-f8b5626b-c86fffb6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-f8b5626b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-f8b5626b-66cd4f74f7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-f8b5626b-66cd4f74f7

SuccessfulCreate

Created pod: payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

openshift-ingress

kubelet

payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-f8b5626b: serviceaccount "payload-processing-e2e-mt-f8b5626b" not found

openshift-ingress

multus

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

Unhealthy

Startup probe failed: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

ProbeError

Startup probe error: Get "http://10.134.0.46:15021/healthz/ready": dial tcp 10.134.0.46:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-f8b5626b-c86fffb6-t7z4h

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-f8b5626b-66cd4f74f7-dcwz9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-mt-f8b5626b-openshift-default-6cd576db96-xwqqr

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-dc3099

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-dc3099

openshift-ingress

deployment-controller

e2e-api-a-dc3099-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-dc3099-openshift-default-665cb6c96d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-dc3099-openshift-default-665cb6c96d

SuccessfulCreate

Created pod: e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

openshift-ingress

multus

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-dc3099

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-dc3099-69445df59 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-dc3099

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc3099-69445df59

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-dc3099-69445df59-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc3099: serviceaccount "payload-processing-e2e-api-a-dc3099" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-dc3099-69445df59-md827

AddedInterface

Add eth0 [10.132.0.89/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc3099-69445df59-md827

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-dc3099: serviceaccount "payload-processing-e2e-api-a-dc3099" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc3099-69445df59-md827

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc3099-69445df59-md827

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-dc3099-69445df59

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-dc3099-69445df59-md827
(x2)

openshift-ingress

kubelet

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

e2e-api-b-bd9741-openshift-default-7fdb8d9f76

SuccessfulCreate

Created pod: e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

openshift-ingress

deployment-controller

e2e-api-b-bd9741-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-bd9741-openshift-default-7fdb8d9f76 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-bd9741

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-bd9741

openshift-ingress

multus

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-bd9741

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-bd9741-764b7ddd98 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-bd9741

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-bd9741-7ff5886947 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bd9741-7ff5886947

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-bd9741-7ff5886947

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-bd9741-7ff5886947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bd9741: serviceaccount "payload-processing-e2e-api-b-bd9741" not found

openshift-ingress

multus

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-bd9741: serviceaccount "payload-processing-e2e-api-b-bd9741" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

openshift-ingress

kubelet

payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t

AddedInterface

Add eth0 [10.132.0.92/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

ProbeError

Readiness probe error: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Unhealthy

Readiness probe failed: Get "http://10.133.0.69:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Unhealthy

Startup probe failed: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

ProbeError

Startup probe error: Get "http://10.133.0.69:15021/healthz/ready": dial tcp 10.133.0.69:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-dc3099-5cd8b49c98-6fwgs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-dc3099-69445df59-md827

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-dc3099-openshift-default-665cb6c96d-d9zs9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-api-b-bd9741-7ff5886947-gc92t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-bd9741-764b7ddd98-hnkpm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-bd9741-openshift-default-7fdb8d9f76-jr6qr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-629537-874d6c74b-qbxz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-629537-744fbb9fd5-h22fs

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-d7f624

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-d7f624

openshift-ingress

deployment-controller

e2e-ipp-a-d7f624-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-d7f624-openshift-default-7784b49d7b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-d7f624-openshift-default-7784b49d7b

SuccessfulCreate

Created pod: e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

openshift-ingress

multus

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Killing

Stopping container istio-proxy
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d7f624: serviceaccount "payload-processing-e2e-ipp-a-d7f624" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-d7f624: serviceaccount "payload-processing-e2e-ipp-a-d7f624" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-d7f624

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-d7f624-7d7fbdf899 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-d7f624

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

AddedInterface

Add eth0 [10.132.0.102/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

AddedInterface

Add eth0 [10.132.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w2-629537-openshift-default-7f6dff4dc4-jfgn6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-459158-548d8779bb-kwbjl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-459158-b4c7dc955-wgjxx

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-b-w2-459158

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-b-w2-459158: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-b-w2-459158": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-b-w2-459158, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 3a88fc54-9916-43af-8cf0-407d007871c2, UID in object meta:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

ProbeError

Readiness probe error: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:35096->10.134.0.53:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Unhealthy

Readiness probe failed: Get "http://10.134.0.53:15021/healthz/ready": read tcp 10.134.0.2:35096->10.134.0.53:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-b-w2-459158-openshift-default-898564cd4-qcw6g

Killing

Stopping container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Unhealthy

Startup probe failed: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

ProbeError

Startup probe error: Get "http://10.134.0.53:15021/healthz/ready": dial tcp 10.134.0.53:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd

SuccessfulCreate

Created pod: e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

openshift-ingress

deployment-controller

e2e-ipp-b-d7dd56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-d7dd56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-d7dd56

openshift-ingress

multus

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-d7dd56

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-d7dd56-656bbffd75 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

AddedInterface

Add eth0 [10.132.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d7dd56: serviceaccount "payload-processing-e2e-ipp-b-d7dd56" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-d7dd56

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d7dd56-656bbffd75

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-d7dd56-656bbffd75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-d7dd56: serviceaccount "payload-processing-e2e-ipp-b-d7dd56" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-d7dd56-656bbffd75

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

ProbeError

Readiness probe error: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Unhealthy

Readiness probe failed: Get "http://10.133.0.73:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

ProbeError

Startup probe error: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Unhealthy

Startup probe failed: Get "http://10.133.0.73:15021/healthz/ready": dial tcp 10.133.0.73:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-8d0f62

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-8d0f62

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

openshift-ingress

deployment-controller

e2e-ipp-cleanup-8d0f62-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8d0f62: serviceaccount "payload-processing-e2e-ipp-cleanup-8d0f62" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-8d0f62

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-8d0f62: serviceaccount "payload-processing-e2e-ipp-cleanup-8d0f62" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-8d0f62

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

AddedInterface

Add eth0 [10.132.0.106/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-8d0f62

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8d0f62: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-8d0f62": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8d0f62, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: c618e757-8aa2-4177-ab62-2ec520ed3f87, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-8d0f62-65ddf664b-dwkc4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-8d0f62-56cbbd6b79-4ztn2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-8d0f62-openshift-default-59b84678bd-76v5g

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-d7f624-5b4c77cf4-fwbxh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-d7f624-7d7fbdf899-cm98c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-d7f624-openshift-default-7784b49d7b-xg4fs

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-d7dd56-f8b557894-4f7gw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-d7dd56-656bbffd75-t5p9j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-d7dd56-openshift-default-6cf4d8d5dd-drfdq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-3d3cac-5755d69fcd-n5j2c

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-3d3cac-5b46d574d9-lgjgg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-a-w3-3d3cac-openshift-default-7655f6d874-6g8s7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-8db5a7-545f7ffdc4-tmzt5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-8db5a7-db7789959-cf68c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-shared-b-w3-8db5a7-openshift-default-6cd76448b4-lb2kd

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: