Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg to ip-10-0-139-142.ec2.internal

openshift-ingress

kube-auth-proxy-7d44b74856-nxglv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d44b74856-nxglv to ip-10-0-134-115.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

Scheduled

Successfully assigned openshift-ingress/e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2 to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

Scheduled

Successfully assigned openshift-ingress/e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7 to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

Scheduled

Successfully assigned openshift-ingress/e2e-noten-df1107-openshift-default-86bdcb7474-dp62q to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

Scheduled

Successfully assigned openshift-ingress/e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-ait-643c297d-65cb59db7-2l894

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-643c297d-65cb59db7-2l894 to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78 to ip-10-0-139-147.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-hh444

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-hh444 to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs to ip-10-0-139-147.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-2j4rk

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2j4rk to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7 to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-qv9kd

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-qv9kd to ip-10-0-134-115.ec2.internal

openshift-ingress

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

Scheduled

Successfully assigned openshift-ingress/e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-autores-66836f-5bbddd787-4f78t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-66836f-5bbddd787-4f78t to ip-10-0-134-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm to ip-10-0-139-147.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2fjbr to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7 to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9 to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-58451477-776b85646-8dbkh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-58451477-776b85646-8dbkh to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77 to ip-10-0-139-147.ec2.internal

openshift-ingress

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt to ip-10-0-139-142.ec2.internal

openshift-ingress

router-default-55546df84-vmltb

Scheduled

Successfully assigned openshift-ingress/router-default-55546df84-vmltb to ip-10-0-134-115.ec2.internal

openshift-ingress

kube-auth-proxy-7d44b74856-lbqgq

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7d44b74856-lbqgq to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv to ip-10-0-134-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4 to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Scheduled

Successfully assigned openshift-ingress/e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn to ip-10-0-134-115.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2 to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-fkscd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-fkscd to ip-10-0-139-142.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg to ip-10-0-139-142.ec2.internal

openshift-ingress

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

Scheduled

Successfully assigned openshift-ingress/e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d to ip-10-0-139-147.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl to ip-10-0-139-147.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-55546df84 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x14)

openshift-ingress

replicaset-controller

router-default-55546df84

FailedCreate

Error creating: pods "router-default-55546df84-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-55546df84

FailedCreate

Error creating: pods "router-default-55546df84-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-55546df84

SuccessfulCreate

Created pod: router-default-55546df84-vmltb
(x6)

openshift-ingress

kubelet

router-default-55546df84-vmltb

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-55546df84-vmltb

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-55546df84-vmltb

AddedInterface

Add eth0 [10.134.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-55546df84-vmltb

Started

Started container router

openshift-ingress

kubelet

router-default-55546df84-vmltb

Created

Created container: router

openshift-ingress

kubelet

router-default-55546df84-vmltb

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:48526e08a2a06d05806dbcf3ddb069e5182371667d9e9f7d2cf09f60cd247d20" already present on machine
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-7d44b74856

FailedCreate

Error creating: pods "kube-auth-proxy-7d44b74856-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7d44b74856

SuccessfulCreate

Created pod: kube-auth-proxy-7d44b74856-lbqgq

openshift-ingress

replicaset-controller

kube-auth-proxy-7d44b74856

SuccessfulCreate

Created pod: kube-auth-proxy-7d44b74856-nxglv

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7d44b74856 from 0 to 2

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-lbqgq

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-nxglv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7d44b74856-lbqgq

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-7d44b74856-nxglv

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-2j4rk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-2j4rk

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2j4rk

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-nxglv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.628s (2.628s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-lbqgq

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-lbqgq

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-lbqgq

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.48s (2.48s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-nxglv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7d44b74856-nxglv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2j4rk

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2j4rk

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.574s (2.574s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2j4rk

Started

Started container discovery

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-nhw9m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.528s (2.528s including waiting). Image size: 181318953 bytes.

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hh444

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-hh444

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-hh444

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hh444

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.951s (2.951s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hh444

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hh444

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hh444

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-hh444

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-2j4rk

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-2j4rk

Killing

Stopping container discovery
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-2fjbr

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.572s (2.572s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-qv9kd

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-fkscd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qv9kd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-fkscd

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fkscd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-qv9kd

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fkscd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.455s (1.455s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fkscd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-fkscd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qv9kd

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qv9kd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.455s (2.456s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-qv9kd

Created

Created container: payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Unhealthy

Readiness probe failed: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

ProbeError

Readiness probe error: Get "http://10.133.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Created

Created container: istio-proxy

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

Unhealthy

Startup probe failed: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-2fjbr

ProbeError

Startup probe error: Get "http://10.133.0.45:15021/healthz/ready": dial tcp 10.133.0.45:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-inf-a-ce1dd5-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-inf-a-ce1dd5

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-ce1dd5

openshift-ingress

replicaset-controller

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4

SuccessfulCreate

Created pod: e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

openshift-ingress

multus

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-ce1dd5

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-ce1dd5-88b68c469 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ce1dd5: serviceaccount "payload-processing-e2e-inf-a-ce1dd5" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ce1dd5-88b68c469

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-ce1dd5-88b68c469-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-ce1dd5: serviceaccount "payload-processing-e2e-inf-a-ce1dd5" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-ce1dd5-88b68c469

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-ce1dd5

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25

Created

Created container: payload-pre-processing

openshift-ingress

multus

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ait-643c297d-openshift-default-5d84d7758d

SuccessfulCreate

Created pod: e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

openshift-ingress

gateway_labeler_controller

e2e-ait-643c297d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-643c297d

openshift-ingress

deployment-controller

e2e-ait-643c297d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-643c297d-openshift-default-5d84d7758d from 0 to 1

openshift-ingress

deployment-controller

e2e-autores-66836f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-66836f-openshift-default-9bdf744f6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-66836f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-66836f

openshift-ingress

replicaset-controller

e2e-autores-66836f-openshift-default-9bdf744f6

SuccessfulCreate

Created pod: e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

openshift-ingress

deployment-controller

payload-processing-e2e-ait-643c297d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-643c297d-65cb59db7 from 0 to 1

openshift-ingress

multus

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-643c297d-65cb59db7

SuccessfulCreate

Created pod: payload-processing-e2e-ait-643c297d-65cb59db7-2l894
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-643c297d-65cb59db7

FailedCreate

Error creating: pods "payload-processing-e2e-ait-643c297d-65cb59db7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-643c297d: serviceaccount "payload-processing-e2e-ait-643c297d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-643c297d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-643c297d-77d6cc756b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-643c297d-77d6cc756b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-643c297d-77d6cc756b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-643c297d-77d6cc756b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-643c297d: serviceaccount "payload-processing-e2e-ait-643c297d" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-643c297d-65cb59db7-2l894

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-643c297d-65cb59db7-2l894

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-643c297d-65cb59db7-2l894

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-643c297d-65cb59db7-2l894

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh

Created

Created container: payload-pre-processing
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-66836f-5bbddd787

FailedCreate

Error creating: pods "payload-processing-e2e-autores-66836f-5bbddd787-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-66836f: serviceaccount "payload-processing-e2e-autores-66836f" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-66836f: serviceaccount "payload-processing-e2e-autores-66836f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-66836f-5bbddd787

SuccessfulCreate

Created pod: payload-processing-e2e-autores-66836f-5bbddd787-4f78t

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-66836f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-66836f-6cdb6c8b58 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-66836f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-66836f-5bbddd787 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-66836f-5bbddd787-4f78t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-66836f-5bbddd787-4f78t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-autores-66836f-5bbddd787-4f78t

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-66836f-5bbddd787-4f78t

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

ProbeError

Startup probe error: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

Unhealthy

Startup probe failed: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

ProbeError

Readiness probe error: Get "http://10.133.0.55:15021/healthz/ready": read tcp 10.133.0.2:35484->10.133.0.55:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Unhealthy

Readiness probe failed: Get "http://10.133.0.55:15021/healthz/ready": read tcp 10.133.0.2:35484->10.133.0.55:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Created

Created container: istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-13374d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-13374d

openshift-ingress

deployment-controller

e2e-inf-b-13374d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-13374d-openshift-default-8698c8f45b from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-13374d-openshift-default-8698c8f45b

SuccessfulCreate

Created pod: e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

openshift-ingress

multus

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Unhealthy

Startup probe failed: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

ProbeError

Startup probe error: Get "http://10.133.0.55:15021/healthz/ready": dial tcp 10.133.0.55:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-13374d-7fc84c75cf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-13374d-7fc84c75cf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-13374d-7fc84c75cf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-13374d: serviceaccount "payload-processing-e2e-inf-b-13374d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-13374d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-13374d: serviceaccount "payload-processing-e2e-inf-b-13374d" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-13374d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-13374d-7fc84c75cf from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-643c297d-77d6cc756b-zlwjh

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-643c297d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-643c297d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-643c297d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-643c297d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: b2757087-cdab-4769-8068-67b255459551, UID in object meta:

openshift-ingress

endpoint-slice-controller

payload-pre-processing-e2e-ait-643c297d

FailedToUpdateEndpointSlices

Error updating Endpoint Slices for Service openshift-ingress/payload-pre-processing-e2e-ait-643c297d: failed to update payload-pre-processing-e2e-ait-643c297d-mn9dv EndpointSlice for Service openshift-ingress/payload-pre-processing-e2e-ait-643c297d: endpointslices.discovery.k8s.io "payload-pre-processing-e2e-ait-643c297d-mn9dv" not found
(x2)

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-643c297d-openshift-default-5d84d7758d-m9n7m

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-643c297d-65cb59db7-2l894

Killing

Stopping container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-migrate-58451477-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-58451477-gw

openshift-ingress

deployment-controller

e2e-migrate-58451477-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-58451477-gw-openshift-default-57d48b4bc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6

SuccessfulCreate

Created pod: e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs
(x2)

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Started

Started container istio-proxy

openshift-ingress

multus

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-58451477-776b85646

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-58451477-776b85646-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-58451477: serviceaccount "payload-processing-e2e-migrate-58451477" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-58451477

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-58451477-7d465dc89d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-58451477-7d465dc89d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-58451477-7d465dc89d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-58451477-7d465dc89d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-58451477: serviceaccount "payload-processing-e2e-migrate-58451477" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-58451477-776b85646

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-58451477-776b85646-8dbkh

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-58451477

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-58451477-776b85646 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd

Started

Started container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-migrate-58451477-776b85646-8dbkh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-58451477-776b85646-8dbkh

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-58451477-776b85646-8dbkh

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-58451477-776b85646-8dbkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-58451477-7d465dc89d-jpvbd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-58451477-776b85646-8dbkh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-ait-f9a25dcc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-f9a25dcc-openshift-default-fbfbb4498 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-f9a25dcc-openshift-default-fbfbb4498

SuccessfulCreate

Created pod: e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

openshift-ingress

gateway_labeler_controller

e2e-ait-f9a25dcc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-f9a25dcc

openshift-ingress

multus

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-migrate-58451477-gw-openshift-default-57d48b4bc6-ngbjs

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

payload-processing-e2e-ait-f9a25dcc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-f9a25dcc-5c66f864f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-f9a25dcc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-f9a25dcc-767c46788b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f9a25dcc-5c66f864f

SuccessfulCreate

Created pod: payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

openshift-ingress

multus

payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f9a25dcc: serviceaccount "payload-processing-e2e-ait-f9a25dcc" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-f9a25dcc-5c66f864f

FailedCreate

Error creating: pods "payload-processing-e2e-ait-f9a25dcc-5c66f864f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-f9a25dcc: serviceaccount "payload-processing-e2e-ait-f9a25dcc" not found

openshift-ingress

kubelet

payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-66836f-5bbddd787-4f78t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-66836f-6cdb6c8b58-hfxqg

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-66836f-openshift-default-9bdf744f6-pcb8b

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-677d3c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-677d3c

openshift-ingress

multus

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

AddedInterface

Add eth0 [10.133.0.65/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-explicit-677d3c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-677d3c-openshift-default-6f899b8648 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-677d3c-openshift-default-6f899b8648

SuccessfulCreate

Created pod: e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-f9a25dcc-767c46788b-mhbdt

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ait-f9a25dcc

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ait-f9a25dcc: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ait-f9a25dcc": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ait-f9a25dcc, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 86df95cd-230a-45f8-82a1-027c5454f94c, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ait-f9a25dcc-5c66f864f-j9fc2

Killing

Stopping container payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

ProbeError

Startup probe error: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-derive-15a3a094-openshift-default-5dcbf68988

SuccessfulCreate

Created pod: e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

openshift-ingress

deployment-controller

e2e-derive-15a3a094-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-15a3a094-openshift-default-5dcbf68988 from 0 to 1

openshift-ingress

kubelet

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-15a3a094

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-15a3a094
(x5)

openshift-ingress

kubelet

e2e-ait-f9a25dcc-openshift-default-fbfbb4498-kcfvk

Unhealthy

Startup probe failed: Get "http://10.132.0.37:15021/healthz/ready": dial tcp 10.132.0.37:15021: connect: connection refused

openshift-ingress

multus

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-677d3c: serviceaccount "payload-processing-e2e-explicit-677d3c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-677d3c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-677d3c-7b55b488f8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-677d3c-6679689cbf

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-677d3c-6679689cbf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-677d3c: serviceaccount "payload-processing-e2e-explicit-677d3c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-677d3c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-677d3c-6679689cbf from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-677d3c-6679689cbf

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

openshift-ingress

multus

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-15a3a094

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-15a3a094-75d48b785c

FailedCreate

Error creating: pods "payload-processing-e2e-derive-15a3a094-75d48b785c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-15a3a094: serviceaccount "payload-processing-e2e-derive-15a3a094" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-15a3a094: serviceaccount "payload-processing-e2e-derive-15a3a094" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-15a3a094-75d48b785c

SuccessfulCreate

Created pod: payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

openshift-ingress

deployment-controller

payload-processing-e2e-derive-15a3a094

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-15a3a094-75d48b785c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

Unhealthy

Startup probe failed: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

ProbeError

Startup probe error: Get "http://10.133.0.65:15021/healthz/ready": dial tcp 10.133.0.65:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-derive-15a3a094-openshift-default-5dcbf68988-dwc6d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-15a3a094-7bbb9dd6b-xh6h2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-15a3a094-75d48b785c-z9svv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-677d3c-6679689cbf-w6qlv

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-677d3c-7b55b488f8-xs9sn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-677d3c-openshift-default-6f899b8648-jpfc7

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-noten-df1107-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-df1107-openshift-default-86bdcb7474 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-df1107-openshift-default-86bdcb7474

SuccessfulCreate

Created pod: e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

openshift-ingress

gateway_labeler_controller

e2e-noten-df1107

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-df1107

openshift-ingress

multus

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-df1107-openshift-default-86bdcb7474-dp62q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

deployment-controller

e2e-mt-ff0028b6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-ff0028b6-openshift-default-5cdf8d746d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-ff0028b6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-ff0028b6

openshift-ingress

replicaset-controller

e2e-mt-ff0028b6-openshift-default-5cdf8d746d

SuccessfulCreate

Created pod: e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

openshift-ingress

multus

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

openshift-ingress

multus

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-ff0028b6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ff0028b6: serviceaccount "payload-processing-e2e-mt-ff0028b6" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ff0028b6-6d8766465

FailedCreate

Error creating: pods "payload-processing-e2e-mt-ff0028b6-6d8766465-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-ff0028b6: serviceaccount "payload-processing-e2e-mt-ff0028b6" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-ff0028b6-6d8766465

SuccessfulCreate

Created pod: payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

openshift-ingress

deployment-controller

payload-processing-e2e-mt-ff0028b6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-ff0028b6-6d8766465 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

ProbeError

Startup probe error: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

Unhealthy

Startup probe failed: Get "http://10.133.0.71:15021/healthz/ready": dial tcp 10.133.0.71:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-ce1dd5-5b9f8685db-p7d25

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-ce1dd5-88b68c469-95gdm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-ff0028b6-77f4fd8db-6z592

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-ff0028b6-6d8766465-f44gw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-ce1dd5-openshift-default-5dffccfbf4-47j4d

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-ff0028b6-openshift-default-5cdf8d746d-nndn7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-inf-b-13374d-7fc84c75cf-d4slg

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-b-13374d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-b-13374d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-b-13374d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-b-13374d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: a36f33ed-5682-44bc-93c3-f8287536663b, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-13374d-6bd4fc48f4-hrxmj

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-13374d-openshift-default-8698c8f45b-w86lm

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb

SuccessfulCreate

Created pod: e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

openshift-ingress

deployment-controller

e2e-shared-a-w2-9eee5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-9eee5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-9eee5d

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-37692b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-37692b

openshift-ingress

deployment-controller

e2e-shared-a-w3-37692b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-37692b-openshift-default-69fbc48894 from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-37692b-openshift-default-69fbc48894

SuccessfulCreate

Created pod: e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

openshift-ingress

multus

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-9eee5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9eee5d: serviceaccount "payload-processing-e2e-shared-a-w2-9eee5d" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-9eee5d: serviceaccount "payload-processing-e2e-shared-a-w2-9eee5d" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-9eee5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-37692b: serviceaccount "payload-processing-e2e-shared-a-w3-37692b" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-37692b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-37692b: serviceaccount "payload-processing-e2e-shared-a-w3-37692b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-37692b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-37692b-6df9c689d9 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Unhealthy

Readiness probe failed: Get "http://10.133.0.75:15021/healthz/ready": read tcp 10.133.0.2:36840->10.133.0.75:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

ProbeError

Readiness probe error: Get "http://10.133.0.75:15021/healthz/ready": read tcp 10.133.0.2:36840->10.133.0.75:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Unhealthy

Readiness probe failed: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

ProbeError

Readiness probe error: Get "http://10.132.0.45:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Unhealthy

Startup probe failed: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

ProbeError

Startup probe error: Get "http://10.132.0.45:15021/healthz/ready": dial tcp 10.132.0.45:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8

SuccessfulCreate

Created pod: e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-dd5958

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-dd5958

openshift-ingress

deployment-controller

e2e-shared-b-w2-dd5958-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd

SuccessfulCreate

Created pod: e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

openshift-ingress

deployment-controller

e2e-shared-b-w3-e96d4c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-e96d4c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-e96d4c

openshift-ingress

multus

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-dd5958: serviceaccount "payload-processing-e2e-shared-b-w2-dd5958" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-dd5958

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-dd5958: serviceaccount "payload-processing-e2e-shared-b-w2-dd5958" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-dd5958

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c: serviceaccount "payload-processing-e2e-shared-b-w3-e96d4c" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-e96d4c: serviceaccount "payload-processing-e2e-shared-b-w3-e96d4c" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-e96d4c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-e96d4c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.568s (1.568s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

ProbeError

Readiness probe error: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Unhealthy

Readiness probe failed: Get "http://10.133.0.77:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

ProbeError

Startup probe error: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Unhealthy

Startup probe failed: Get "http://10.133.0.77:15021/healthz/ready": dial tcp 10.133.0.77:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-6c869d5a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-6c869d5a-openshift-default-75b47d447b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-6c869d5a-openshift-default-75b47d447b

SuccessfulCreate

Created pod: e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

openshift-ingress

gateway_labeler_controller

e2e-mt-6c869d5a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-6c869d5a

openshift-ingress

multus

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6c869d5a-579f5569d5

FailedCreate

Error creating: pods "payload-processing-e2e-mt-6c869d5a-579f5569d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6c869d5a: serviceaccount "payload-processing-e2e-mt-6c869d5a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-6c869d5a-579f5569d5

SuccessfulCreate

Created pod: payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-6c869d5a: serviceaccount "payload-processing-e2e-mt-6c869d5a" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-6c869d5a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-6c869d5a-859f4d9466 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-mt-6c869d5a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-6c869d5a-579f5569d5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw

AddedInterface

Add eth0 [10.133.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

ProbeError

Startup probe error: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

Unhealthy

Startup probe failed: Get "http://10.133.0.84:15021/healthz/ready": dial tcp 10.133.0.84:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-6c869d5a-579f5569d5-v9qkw

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-6c869d5a-859f4d9466-pxs9p

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-6c869d5a-openshift-default-75b47d447b-5kft2

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-aef6df-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-aef6df-openshift-default-5fccfdc696 from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-aef6df-openshift-default-5fccfdc696

SuccessfulCreate

Created pod: e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

openshift-ingress

gateway_labeler_controller

e2e-api-a-aef6df

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-aef6df

openshift-ingress

multus

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-aef6df

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-aef6df-7778c85c5f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-aef6df

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-aef6df: serviceaccount "payload-processing-e2e-api-a-aef6df" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-aef6df-7778c85c5f

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-aef6df-7778c85c5f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-aef6df: serviceaccount "payload-processing-e2e-api-a-aef6df" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-aef6df-7778c85c5f

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

openshift-ingress

kubelet

payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9

Created

Created container: payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

e2e-api-b-5ee885-openshift-default-7c658c9f5d

SuccessfulCreate

Created pod: e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

openshift-ingress

deployment-controller

e2e-api-b-5ee885-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-5ee885-openshift-default-7c658c9f5d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-5ee885

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-5ee885

openshift-ingress

multus

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

Unhealthy

Startup probe failed: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

ProbeError

Startup probe error: Get "http://10.133.0.92:15021/healthz/ready": dial tcp 10.133.0.92:15021: connect: connection refused body:

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-5ee885

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-5ee885-7459d8c66 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-5ee885

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-5ee885-55dddb445 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5ee885-7459d8c66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-5ee885-7459d8c66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5ee885: serviceaccount "payload-processing-e2e-api-b-5ee885" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5ee885-55dddb445

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-5ee885-7459d8c66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-5ee885-55dddb445

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-5ee885-55dddb445-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-5ee885: serviceaccount "payload-processing-e2e-api-b-5ee885" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

ProbeError

Startup probe error: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

Unhealthy

Startup probe failed: Get "http://10.133.0.94:15021/healthz/ready": dial tcp 10.133.0.94:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-api-a-aef6df-7778c85c5f-8h794

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-aef6df-b7ddf76fd-62bc9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-aef6df-openshift-default-5fccfdc696-57h7j

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-5ee885-7459d8c66-4znnt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-5ee885-55dddb445-6gsj4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-5ee885-openshift-default-7c658c9f5d-j6qtr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-9eee5d-54998fc7d6-lrl58

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-9eee5d-7b98bd7947-svcx7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-9eee5d-openshift-default-77968dbcfb-4b9zr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-dd5958-687bc659f4-g8qds

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-dd5958-6c969dddfc-rmfjn

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-dd5958-openshift-default-6dc54b98f8-fcmtg

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-51d6fb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-51d6fb

openshift-ingress

multus

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-a-51d6fb-openshift-default-7c6d696494

SuccessfulCreate

Created pod: e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

openshift-ingress

deployment-controller

e2e-ipp-a-51d6fb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-51d6fb-openshift-default-7c6d696494 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-51d6fb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-51d6fb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-51d6fb: serviceaccount "payload-processing-e2e-ipp-a-51d6fb" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-51d6fb: serviceaccount "payload-processing-e2e-ipp-a-51d6fb" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

ProbeError

Readiness probe error: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Unhealthy

Readiness probe failed: Get "http://10.132.0.62:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

ProbeError

Startup probe error: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Unhealthy

Startup probe failed: Get "http://10.132.0.62:15021/healthz/ready": dial tcp 10.132.0.62:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-c416fa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-c416fa-openshift-default-657cb586b from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-c416fa-openshift-default-657cb586b

SuccessfulCreate

Created pod: e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-c416fa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-c416fa

openshift-ingress

multus

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

AddedInterface

Add eth0 [10.133.0.100/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c416fa: serviceaccount "payload-processing-e2e-ipp-b-c416fa" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-c416fa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

AddedInterface

Add eth0 [10.133.0.101/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

Started

Started container payload-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-c416fa: serviceaccount "payload-processing-e2e-ipp-b-c416fa" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-c416fa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7 from 0 to 1
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

Unhealthy

Startup probe failed: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

ProbeError

Startup probe error: Get "http://10.133.0.100:15021/healthz/ready": dial tcp 10.133.0.100:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-da536f-openshift-default-74864b546

SuccessfulCreate

Created pod: e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

openshift-ingress

deployment-controller

e2e-ipp-cleanup-da536f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-da536f-openshift-default-74864b546 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-da536f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-da536f

openshift-ingress

multus

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-da536f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-da536f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f: serviceaccount "payload-processing-e2e-ipp-cleanup-da536f" not found
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-da536f: serviceaccount "payload-processing-e2e-ipp-cleanup-da536f" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

AddedInterface

Add eth0 [10.133.0.104/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

AddedInterface

Add eth0 [10.133.0.103/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-cleanup-da536f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-cleanup-da536f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-da536f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5d85a622-5a74-47f0-9c0b-11a905f61723, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-da536f-5f6fbf95f7-pbv77

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-da536f-78cbbc54d6-bdgg4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-cleanup-da536f-openshift-default-74864b546-rg4tf

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-51d6fb-685b5c8f78-l9hkc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-51d6fb-67b79f7bfc-qbl4x

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-51d6fb-openshift-default-7c6d696494-n8p2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-c416fa-64c98fc46b-l8qhb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-c416fa-7f4c4cc6f7-jnssd

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-c416fa-openshift-default-657cb586b-mmncw

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-37692b-6df9c689d9-grn4k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-37692b-7f8f7bdc9d-wcnnd

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w3-37692b

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w3-37692b: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w3-37692b": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w3-37692b, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ce0a2df8-ad02-427c-bfd0-4f6a1dde085c, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w3-37692b-openshift-default-69fbc48894-2v97b

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-e96d4c-854b89c54c-fwghl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-e96d4c-558d576594-75pdw

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-e96d4c-openshift-default-7f599c4bd-r5n78

Killing

Stopping container istio-proxy