Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928 to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc to ip-10-0-139-133.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcc82bp to ip-10-0-139-133.ec2.internal

openshift-ingress

kube-auth-proxy-688cb69f77-9llgl

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-688cb69f77-9llgl to ip-10-0-130-59.ec2.internal

openshift-ingress

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf to ip-10-0-139-133.ec2.internal

openshift-ingress

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8 to ip-10-0-139-133.ec2.internal

openshift-ingress

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm to ip-10-0-139-133.ec2.internal

openshift-ingress

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf to ip-10-0-139-133.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m to ip-10-0-139-133.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-bj9z5

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bj9z5 to ip-10-0-130-59.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-lwrx8

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-lwrx8 to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk to ip-10-0-129-68.ec2.internal

openshift-ingress

kube-auth-proxy-688cb69f77-h56qn

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-688cb69f77-h56qn to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7 to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-zpkr4

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-zpkr4 to ip-10-0-130-59.ec2.internal

openshift-ingress

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Scheduled

Successfully assigned openshift-ingress/e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5 to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56 to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64 to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6 to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6 to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5 to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Scheduled

Successfully assigned openshift-ingress/e2e-mt-062bb857-openshift-default-664d988556-6t7qg to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb to ip-10-0-139-133.ec2.internal

openshift-ingress

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Scheduled

Successfully assigned openshift-ingress/e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2 to ip-10-0-129-68.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6t8xw to ip-10-0-139-133.ec2.internal

openshift-ingress

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-ckqsj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-ckqsj to ip-10-0-130-59.ec2.internal

openshift-ingress

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9 to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2 to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

Scheduled

Successfully assigned openshift-ingress/e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv to ip-10-0-129-68.ec2.internal

openshift-ingress

router-default-6b6767dd58-vrxv6

Scheduled

Successfully assigned openshift-ingress/router-default-6b6767dd58-vrxv6 to ip-10-0-130-59.ec2.internal

openshift-ingress

router-default-6b6767dd58-vrxv6

FailedScheduling

0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2 to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4 to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk to ip-10-0-139-133.ec2.internal

openshift-ingress

payload-processing-e2e-mt-062bb857-8558476949-wxsd6

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-062bb857-8558476949-wxsd6 to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4 to ip-10-0-129-68.ec2.internal

openshift-ingress

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

Scheduled

Successfully assigned openshift-ingress/e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln to ip-10-0-129-68.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr to ip-10-0-129-68.ec2.internal

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6b6767dd58 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-6b6767dd58

FailedCreate

Error creating: pods "router-default-6b6767dd58-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-6b6767dd58

FailedCreate

Error creating: pods "router-default-6b6767dd58-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6b6767dd58

SuccessfulCreate

Created pod: router-default-6b6767dd58-vrxv6
(x6)

openshift-ingress

kubelet

router-default-6b6767dd58-vrxv6

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt
(x6)

openshift-ingress

kubelet

router-default-6b6767dd58-vrxv6

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found

openshift-ingress

multus

router-default-6b6767dd58-vrxv6

AddedInterface

Add eth0 [10.132.0.9/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6b6767dd58-vrxv6

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-6b6767dd58-vrxv6

Created

Created container: router

openshift-ingress

kubelet

router-default-6b6767dd58-vrxv6

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-688cb69f77 from 0 to 2
(x3)

openshift-ingress

replicaset-controller

kube-auth-proxy-688cb69f77

FailedCreate

Error creating: pods "kube-auth-proxy-688cb69f77-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-688cb69f77

SuccessfulCreate

Created pod: kube-auth-proxy-688cb69f77-9llgl

openshift-ingress

replicaset-controller

kube-auth-proxy-688cb69f77

SuccessfulCreate

Created pod: kube-auth-proxy-688cb69f77-h56qn

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-h56qn

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-9llgl

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-9llgl

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-bj9z5

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

openshift-ingress

multus

kube-auth-proxy-688cb69f77-h56qn

AddedInterface

Add eth0 [10.134.0.18/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-bj9z5

openshift-ingress

multus

kube-auth-proxy-688cb69f77-9llgl

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-h56qn

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-h56qn

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-9llgl

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.051s (3.051s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-9llgl

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-9llgl

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-h56qn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.06s (3.06s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-688cb69f77-h56qn

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.86s (3.86s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 0 to 1

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.025s (3.025s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-4qq6m

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.9s (2.9s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-6745bb66bc from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-6745bb66bc

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-6745bb66bcc82bp
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

ProbeError

Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body:
(x3)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Unhealthy

Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-6745bb66bcc82bp

Killing

Stopping container istio-proxy

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-lwrx8

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lwrx8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-lwrx8

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lwrx8

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lwrx8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.529s (2.529s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-lwrx8

Started

Started container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-bj9z5

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-bj9z5

Killing

Stopping container discovery

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-6t8xw

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-zpkr4

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-ckqsj

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zpkr4

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-5b54b7fbb7-zpkr4

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ckqsj

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-ckqsj

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ckqsj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ckqsj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zpkr4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zpkr4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-zpkr4

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.212s (2.212s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-ckqsj

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.255s (2.255s including waiting). Image size: 166449337 bytes.
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

Unhealthy

Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-6t8xw

ProbeError

Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body:

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-7576a1

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-7576a1-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-7576a1-authn-ssl" already exists

openshift-ingress

replicaset-controller

e2e-inf-a-7576a1-openshift-default-5fb65c59fb

SuccessfulCreate

Created pod: e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

openshift-ingress

gateway_labeler_controller

e2e-inf-a-7576a1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-7576a1

openshift-ingress

deployment-controller

e2e-inf-a-7576a1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-7576a1-openshift-default-5fb65c59fb from 0 to 1

openshift-ingress

multus

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-7576a1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-7576a1-66659b7f75 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

AddedInterface

Add eth0 [10.134.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7576a1: serviceaccount "payload-processing-e2e-inf-a-7576a1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-7576a1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7576a1-66659b7f75

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-7576a1-66659b7f75

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-7576a1-66659b7f75-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-7576a1: serviceaccount "payload-processing-e2e-inf-a-7576a1" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.853s (1.853s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.354s (2.354s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

Created

Created container: payload-processing

openshift-ingress

gateway_labeler_controller

e2e-ait-772cfbbb

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-772cfbbb

openshift-ingress

gateway_labeler_controller

e2e-autores-98aa83

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-98aa83

openshift-ingress

replicaset-controller

e2e-ait-772cfbbb-openshift-default-7fbfc4764b

SuccessfulCreate

Created pod: e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

openshift-ingress

deployment-controller

e2e-ait-772cfbbb-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-772cfbbb-openshift-default-7fbfc4764b from 0 to 1

openshift-ingress

multus

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-autores-98aa83-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-98aa83-openshift-default-7db4c69f78 from 0 to 1

openshift-ingress

replicaset-controller

e2e-autores-98aa83-openshift-default-7db4c69f78

SuccessfulCreate

Created pod: e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

openshift-ingress

multus

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-772cfbbb: serviceaccount "payload-processing-e2e-ait-772cfbbb" not found

openshift-ingress

multus

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-772cfbbb-744ccf7f65

SuccessfulCreate

Created pod: payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

openshift-ingress

deployment-controller

payload-processing-e2e-ait-772cfbbb

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-772cfbbb-744ccf7f65 from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-772cfbbb

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-772cfbbb-6f57569b58 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-772cfbbb-744ccf7f65

FailedCreate

Error creating: pods "payload-processing-e2e-ait-772cfbbb-744ccf7f65-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-772cfbbb: serviceaccount "payload-processing-e2e-ait-772cfbbb" not found

openshift-ingress

multus

payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-98aa83

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-98aa83-55467cbff4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-98aa83-55467cbff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

openshift-ingress

multus

payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-98aa83-7984bcbc7c

FailedCreate

Error creating: pods "payload-processing-e2e-autores-98aa83-7984bcbc7c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-98aa83: serviceaccount "payload-processing-e2e-autores-98aa83" not found

openshift-ingress

deployment-controller

payload-processing-e2e-autores-98aa83

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-98aa83-7984bcbc7c from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-98aa83-7984bcbc7c

SuccessfulCreate

Created pod: payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-98aa83-55467cbff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-98aa83-55467cbff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-98aa83: serviceaccount "payload-processing-e2e-autores-98aa83" not found

openshift-ingress

multus

payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

ProbeError

Readiness probe error: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Unhealthy

Readiness probe failed: Get "http://10.133.0.40:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

ProbeError

Startup probe error: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Unhealthy

Startup probe failed: Get "http://10.133.0.40:15021/healthz/ready": dial tcp 10.133.0.40:15021: connect: connection refused

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": read tcp 10.133.0.2:49380->10.133.0.42:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": read tcp 10.133.0.2:49380->10.133.0.42:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Unhealthy

Readiness probe failed: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:57278->10.133.0.43:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

ProbeError

Readiness probe error: Get "http://10.133.0.43:15021/healthz/ready": read tcp 10.133.0.2:57278->10.133.0.43:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-inf-b-fb35b9-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-fb35b9-openshift-default-6b6d66498 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-fb35b9-openshift-default-6b6d66498

SuccessfulCreate

Created pod: e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

openshift-ingress

multus

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-inf-b-fb35b9

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-fb35b9
(x2)

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Unhealthy

Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

ProbeError

Startup probe error: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fb35b9: serviceaccount "payload-processing-e2e-inf-b-fb35b9" not found

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-fb35b9

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-fb35b9-855b7f79bf from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-fb35b9

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fb35b9-855b7f79bf

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-fb35b9-855b7f79bf-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-fb35b9: serviceaccount "payload-processing-e2e-inf-b-fb35b9" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-fb35b9-855b7f79bf

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-772cfbbb-openshift-default-7fbfc4764b-pw6wb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-772cfbbb-6f57569b58-6gvls

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-772cfbbb-744ccf7f65-th79w

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-41f030dc-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-41f030dc-gw-openshift-default-789bc8784 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-migrate-41f030dc-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-41f030dc-gw

openshift-ingress

replicaset-controller

e2e-migrate-41f030dc-gw-openshift-default-789bc8784

SuccessfulCreate

Created pod: e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

ProbeError

Startup probe error: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Unhealthy

Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4s (4s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-41f030dc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-41f030dc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-41f030dc-5b78f884c4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-41f030dc-5b78f884c4

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

openshift-ingress

multus

payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-41f030dc: serviceaccount "payload-processing-e2e-migrate-41f030dc" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-41f030dc-5b78f884c4

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-41f030dc-5b78f884c4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-41f030dc: serviceaccount "payload-processing-e2e-migrate-41f030dc" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

ProbeError

Readiness probe error: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Unhealthy

Readiness probe failed: Get "http://10.134.0.36:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Unhealthy

Startup probe failed: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

ProbeError

Startup probe error: Get "http://10.134.0.36:15021/healthz/ready": dial tcp 10.134.0.36:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-migrate-41f030dc-5b78f884c4-982bg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-migrate-41f030dc-gw-openshift-default-789bc8784-b4mp6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-41f030dc-7579b4dd58-gc928

Killing

Stopping container payload-pre-processing

openshift-ingress

multus

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-ait-67fd52b1

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-67fd52b1-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-67fd52b1-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-67fd52b1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-67fd52b1

openshift-ingress

deployment-controller

e2e-ait-67fd52b1-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-67fd52b1-openshift-default-579f79c6db from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-67fd52b1-openshift-default-579f79c6db

SuccessfulCreate

Created pod: e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

openshift-ingress

deployment-controller

payload-processing-e2e-ait-67fd52b1

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-67fd52b1-7967ffbb5c from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-67fd52b1

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-67fd52b1-7967ffbb5c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-67fd52b1-7967ffbb5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-67fd52b1: serviceaccount "payload-processing-e2e-ait-67fd52b1" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-67fd52b1: serviceaccount "payload-processing-e2e-ait-67fd52b1" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-67fd52b1-7967ffbb5c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

openshift-ingress

kubelet

payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-98aa83-55467cbff4-dxhjb

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-98aa83-7984bcbc7c-qlq9n

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

ProbeError

Readiness probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Unhealthy

Readiness probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-explicit-f615cc

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-f615cc
(x5)

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

ProbeError

Startup probe error: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Unhealthy

Startup probe failed: Get "http://10.133.0.48:15021/healthz/ready": dial tcp 10.133.0.48:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-explicit-f615cc-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-f615cc-openshift-default-67987d7bc6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-f615cc-openshift-default-67987d7bc6

SuccessfulCreate

Created pod: e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

openshift-ingress

kubelet

e2e-autores-98aa83-openshift-default-7db4c69f78-qjblt

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f615cc-598988fd5c

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-f615cc-598988fd5c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f615cc: serviceaccount "payload-processing-e2e-explicit-f615cc" not found

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-f615cc

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-f615cc-598988fd5c from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-f615cc-598988fd5c

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-f615cc: serviceaccount "payload-processing-e2e-explicit-f615cc" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-f615cc

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-67fd52b1-56965dbb5d-ghqtc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-67fd52b1-7967ffbb5c-mlnnk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-9e0ca8ed

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-9e0ca8ed

openshift-ingress

deployment-controller

e2e-derive-9e0ca8ed-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-9e0ca8ed-openshift-default-748874ccdd from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-9e0ca8ed-openshift-default-748874ccdd

SuccessfulCreate

Created pod: e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

openshift-ingress

multus

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-67fd52b1-openshift-default-579f79c6db-nt8nb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9e0ca8ed-694747fc45

FailedCreate

Error creating: pods "payload-processing-e2e-derive-9e0ca8ed-694747fc45-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9e0ca8ed: serviceaccount "payload-processing-e2e-derive-9e0ca8ed" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-9e0ca8ed

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-9e0ca8ed-694747fc45 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-9e0ca8ed-694747fc45

SuccessfulCreate

Created pod: payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-9e0ca8ed

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-9e0ca8ed: serviceaccount "payload-processing-e2e-derive-9e0ca8ed" not found

openshift-ingress

kubelet

payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

ProbeError

Startup probe error: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

Unhealthy

Startup probe failed: Get "http://10.134.0.42:15021/healthz/ready": dial tcp 10.134.0.42:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Unhealthy

Readiness probe failed: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:49974->10.133.0.51:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

ProbeError

Readiness probe error: Get "http://10.133.0.51:15021/healthz/ready": read tcp 10.133.0.2:49974->10.133.0.51:15021: read: connection reset by peer body:
(x4)

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Unhealthy

Startup probe failed: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused
(x4)

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

ProbeError

Startup probe error: Get "http://10.133.0.51:15021/healthz/ready": dial tcp 10.133.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-derive-9e0ca8ed-694747fc45-8z4sf

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-derive-9e0ca8ed

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-derive-9e0ca8ed: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-derive-9e0ca8ed": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-derive-9e0ca8ed, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 277dc5c3-2cac-4a75-a400-3c50c79e85a6, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-9e0ca8ed-67788885f4-k65ln

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-derive-9e0ca8ed-openshift-default-748874ccdd-w5jpg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-explicit-f615cc-598988fd5c-jhn8s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-f615cc-67d6bcc77d-ch9tr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-f615cc-openshift-default-67987d7bc6-mlk9d

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-noten-1d8e56-openshift-default-7499fb7fd6

SuccessfulCreate

Created pod: e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

openshift-ingress

deployment-controller

e2e-noten-1d8e56-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-1d8e56-openshift-default-7499fb7fd6 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-noten-1d8e56

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-1d8e56

openshift-ingress

kubelet

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

Started

Started container istio-proxy

openshift-ingress

multus

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-1d8e56-openshift-default-7499fb7fd6-4zr2c

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

deployment-controller

e2e-mt-062bb857-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-062bb857-openshift-default-664d988556 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-062bb857

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-062bb857

openshift-ingress

replicaset-controller

e2e-mt-062bb857-openshift-default-664d988556

SuccessfulCreate

Created pod: e2e-mt-062bb857-openshift-default-664d988556-6t7qg

openshift-ingress

multus

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-7576a1-7f6675bc54-48rcd

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-7576a1-66659b7f75-mf57x

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-062bb857

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-062bb857-8558476949 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-062bb857-8558476949

FailedCreate

Error creating: pods "payload-processing-e2e-mt-062bb857-8558476949-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-062bb857: serviceaccount "payload-processing-e2e-mt-062bb857" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-062bb857-8558476949

SuccessfulCreate

Created pod: payload-processing-e2e-mt-062bb857-8558476949-wxsd6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-062bb857

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-062bb857-dd6c48c74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-062bb857-dd6c48c74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-062bb857-dd6c48c74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-062bb857-dd6c48c74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-062bb857: serviceaccount "payload-processing-e2e-mt-062bb857" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-062bb857-8558476949-wxsd6

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-062bb857-8558476949-wxsd6

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-062bb857-8558476949-wxsd6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-062bb857-8558476949-wxsd6

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-inf-a-7576a1-openshift-default-5fb65c59fb-jmdd8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Unhealthy

Readiness probe failed: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

ProbeError

Readiness probe error: Get "http://10.134.0.51:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-fb35b9-855b7f79bf-rm4fl

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-fb35b9-8459b944fd-v8crn

Killing

Stopping container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Unhealthy

Startup probe failed: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

ProbeError

Startup probe error: Get "http://10.134.0.51:15021/healthz/ready": dial tcp 10.134.0.51:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-18c2d2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-18c2d2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-18c2d2

openshift-ingress

replicaset-controller

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b

SuccessfulCreate

Created pod: e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

openshift-ingress

multus

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-b-fb35b9-openshift-default-6b6d66498-qqvsr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2: serviceaccount "payload-processing-e2e-shared-a-w3-18c2d2" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-18c2d2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-18c2d2: serviceaccount "payload-processing-e2e-shared-a-w3-18c2d2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-18c2d2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

ProbeError

Readiness probe error: Get "http://10.133.0.54:15021/healthz/ready": read tcp 10.133.0.2:44468->10.133.0.54:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Unhealthy

Readiness probe failed: Get "http://10.133.0.54:15021/healthz/ready": read tcp 10.133.0.2:44468->10.133.0.54:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-062bb857-8558476949-wxsd6

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-062bb857-dd6c48c74-8rkfl

Killing

Stopping container payload-pre-processing
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-062bb857-openshift-default-664d988556-6t7qg

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-f89a79

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-f89a79

openshift-ingress

replicaset-controller

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd

SuccessfulCreate

Created pod: e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

openshift-ingress

deployment-controller

e2e-shared-b-w3-f89a79-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-f89a79-openshift-default-74466b87cd from 0 to 1

openshift-ingress

multus

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

Started

Started container payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-f89a79

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

Created

Created container: payload-pre-processing
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f89a79: serviceaccount "payload-processing-e2e-shared-b-w3-f89a79" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f89a79-986569f89

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-f89a79

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-f89a79-986569f89 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-f89a79-986569f89

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-f89a79-986569f89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-f89a79: serviceaccount "payload-processing-e2e-shared-b-w3-f89a79" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

Started

Started container payload-processing

openshift-ingress

deployment-controller

e2e-shared-a-w2-d1e553-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-d1e553-openshift-default-55f479f488 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-d1e553

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-d1e553

openshift-ingress

replicaset-controller

e2e-shared-a-w2-d1e553-openshift-default-55f479f488

SuccessfulCreate

Created pod: e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

openshift-ingress

multus

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

AddedInterface

Add eth0 [10.133.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

ProbeError

Readiness probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553: serviceaccount "payload-processing-e2e-shared-a-w2-d1e553" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-d1e553

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-d1e553

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-d1e553-c55bc6579 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-d1e553: serviceaccount "payload-processing-e2e-shared-a-w2-d1e553" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

ProbeError

Readiness probe error: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:58316->10.133.0.57:15021: read: connection reset by peer body:

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Unhealthy

Readiness probe failed: Get "http://10.133.0.57:15021/healthz/ready": read tcp 10.133.0.2:58316->10.133.0.57:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Started

Started container istio-proxy
(x4)

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

ProbeError

Startup probe error: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused body:
(x4)

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Unhealthy

Startup probe failed: Get "http://10.133.0.57:15021/healthz/ready": dial tcp 10.133.0.57:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4

SuccessfulCreate

Created pod: e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

openshift-ingress

deployment-controller

e2e-shared-b-w2-a08ea2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a08ea2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a08ea2

openshift-ingress

multus

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a08ea2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2: serviceaccount "payload-processing-e2e-shared-b-w2-a08ea2" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a08ea2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a08ea2: serviceaccount "payload-processing-e2e-shared-b-w2-a08ea2" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-mt-156d6252

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-156d6252

openshift-ingress

deployment-controller

e2e-mt-156d6252-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-156d6252-openshift-default-c88fc69fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-156d6252-openshift-default-c88fc69fb

SuccessfulCreate

Created pod: e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

openshift-ingress

multus

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-mt-156d6252

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-156d6252-86dcbfdd57 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-156d6252-86dcbfdd57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-156d6252-86dcbfdd57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-156d6252: serviceaccount "payload-processing-e2e-mt-156d6252" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-156d6252-86dcbfdd57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-156d6252-6f67784cf8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-156d6252

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-156d6252-6f67784cf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-156d6252-6f67784cf8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-156d6252-6f67784cf8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-156d6252: serviceaccount "payload-processing-e2e-mt-156d6252" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

AddedInterface

Add eth0 [10.134.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

Unhealthy

Startup probe failed: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

ProbeError

Startup probe error: Get "http://10.134.0.67:15021/healthz/ready": dial tcp 10.134.0.67:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-156d6252-86dcbfdd57-6ddxk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-156d6252-6f67784cf8-8tpm6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-156d6252-openshift-default-c88fc69fb-r2jcv

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-5ff68c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-5ff68c-openshift-default-85bdbcf7b8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-a-5ff68c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-5ff68c

openshift-ingress

replicaset-controller

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8

SuccessfulCreate

Created pod: e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

openshift-ingress

multus

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

AddedInterface

Add eth0 [10.133.0.66/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-5ff68c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-5ff68c-9d76c4658 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5ff68c-5c7bf7598c

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-5ff68c-5c7bf7598c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5ff68c: serviceaccount "payload-processing-e2e-api-a-5ff68c" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-5ff68c-5c7bf7598c

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-5ff68c: serviceaccount "payload-processing-e2e-api-a-5ff68c" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-5ff68c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-5ff68c-5c7bf7598c from 0 to 1

openshift-ingress

multus

payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

AddedInterface

Add eth0 [10.134.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Unhealthy

Readiness probe failed: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

ProbeError

Readiness probe error: Get "http://10.133.0.66:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

ProbeError

Startup probe error: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Unhealthy

Startup probe failed: Get "http://10.133.0.66:15021/healthz/ready": dial tcp 10.133.0.66:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-api-b-da7b8f-openshift-default-5dbffd594

SuccessfulCreate

Created pod: e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

openshift-ingress

gateway_labeler_controller

e2e-api-b-da7b8f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-da7b8f

openshift-ingress

deployment-controller

e2e-api-b-da7b8f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-da7b8f-openshift-default-5dbffd594 from 0 to 1

openshift-ingress

multus

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

AddedInterface

Add eth0 [10.134.0.78/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-da7b8f: serviceaccount "payload-processing-e2e-api-b-da7b8f" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-da7b8f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-da7b8f-89c54cf77 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-da7b8f-89c54cf77

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-da7b8f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-da7b8f-6c857fc966 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-da7b8f-89c54cf77

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-da7b8f-89c54cf77-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-da7b8f: serviceaccount "payload-processing-e2e-api-b-da7b8f" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

Unhealthy

Startup probe failed: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

ProbeError

Startup probe error: Get "http://10.134.0.78:15021/healthz/ready": dial tcp 10.134.0.78:15021: connect: connection refused body:

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-5ff68c

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-5ff68c: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-5ff68c": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-5ff68c, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d0a6a57f-bfaf-496b-b631-4ceec1c7e289, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-5ff68c-5c7bf7598c-b8tkm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-5ff68c-9d76c4658-drpg9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

kubelet

e2e-api-a-5ff68c-openshift-default-85bdbcf7b8-92ljx

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-da7b8f-6c857fc966-vvmj2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-da7b8f-89c54cf77-692cm

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-da7b8f-openshift-default-5dbffd594-t82n4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-d1e553-796d4767d6-tzw64

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-d1e553-c55bc6579-tk8vq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w2-d1e553-openshift-default-55f479f488-5fpht

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-ipp-a-3db7ea-openshift-default-6765ff5646

SuccessfulCreate

Created pod: e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

openshift-ingress

GatewayAuthBootstrap

e2e-ipp-a-3db7ea

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ipp-a-3db7ea-authn-ssl: envoyfilters.networking.istio.io "e2e-ipp-a-3db7ea-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3db7ea

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3db7ea

openshift-ingress

multus

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ipp-a-3db7ea-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3db7ea-openshift-default-6765ff5646 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3db7ea

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3db7ea-6f96d7b669 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3db7ea

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

AddedInterface

Add eth0 [10.133.0.73/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3db7ea: serviceaccount "payload-processing-e2e-ipp-a-3db7ea" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3db7ea: serviceaccount "payload-processing-e2e-ipp-a-3db7ea" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a08ea2-67579c6d6f-9dx8s

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a08ea2-84f8b84c4b-nxfz5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a08ea2-openshift-default-7cb77f7dc4-vjnnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": read tcp 10.133.0.2:42896->10.133.0.72:15021: read: connection reset by peer

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": read tcp 10.133.0.2:42896->10.133.0.72:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

deployment-controller

e2e-ipp-b-a5be11-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-a5be11-openshift-default-697f77d946 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-a5be11-openshift-default-697f77d946

SuccessfulCreate

Created pod: e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-a5be11

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-a5be11

openshift-ingress

multus

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

AddedInterface

Add eth0 [10.134.0.83/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-a5be11

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a5be11-686bfb7d89

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-a5be11-686bfb7d89-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a5be11: serviceaccount "payload-processing-e2e-ipp-b-a5be11" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-a5be11

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-a5be11-686bfb7d89 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-a5be11: serviceaccount "payload-processing-e2e-ipp-b-a5be11" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

AddedInterface

Add eth0 [10.134.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

Started

Started container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-a5be11-686bfb7d89

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

AddedInterface

Add eth0 [10.134.0.84/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

Unhealthy

Startup probe failed: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

ProbeError

Startup probe error: Get "http://10.134.0.83:15021/healthz/ready": dial tcp 10.134.0.83:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-47deee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-47deee

openshift-ingress

deployment-controller

e2e-ipp-cleanup-47deee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-47deee-openshift-default-8669f75544 from 0 to 1

openshift-ingress

multus

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-47deee-openshift-default-8669f75544

SuccessfulCreate

Created pod: e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-47deee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-47deee: serviceaccount "payload-processing-e2e-ipp-cleanup-47deee" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-47deee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-47deee: serviceaccount "payload-processing-e2e-ipp-cleanup-47deee" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

AddedInterface

Add eth0 [10.134.0.87/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-47deee-6fddf66d78-bswlc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-47deee-577b6bd8f5-qnxg2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-cleanup-47deee-openshift-default-8669f75544-gjbnv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3db7ea-6f96d7b669-n8w56

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3db7ea-669647fc66-bfsz2

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-a-3db7ea-openshift-default-6765ff5646-ldkpf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-a5be11-5fd949fb86-6kjb5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-a5be11-686bfb7d89-482zx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-a5be11-openshift-default-697f77d946-bpwv7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-18c2d2-57d5c478bb-fnmsj

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-18c2d2-77dbf75579-7z2p4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-18c2d2-openshift-default-7c699f559b-kshdk

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-f89a79-59f7d86f74-8mbnq

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-f89a79-986569f89-hmzhh

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-f89a79-openshift-default-74466b87cd-g5ncf

Killing

Stopping container istio-proxy