Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-derive-320efe75-589579586f-v5dnz

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-320efe75-589579586f-v5dnz to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks to ip-10-0-132-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Scheduled

Successfully assigned openshift-ingress/e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb to ip-10-0-132-175.ec2.internal

openshift-ingress

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

Scheduled

Successfully assigned openshift-ingress/e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k to ip-10-0-131-215.ec2.internal

openshift-ingress

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

Scheduled

Successfully assigned openshift-ingress/e2e-noten-860c6d-openshift-default-57cd778746-j8wcp to ip-10-0-131-215.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z to ip-10-0-131-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj to ip-10-0-132-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94 to ip-10-0-132-175.ec2.internal

openshift-ingress

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

Scheduled

Successfully assigned openshift-ingress/e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb to ip-10-0-132-4.ec2.internal

openshift-ingress

kube-auth-proxy-59d7d88d64-pvnz2

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59d7d88d64-pvnz2 to ip-10-0-131-215.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-1038cd-openshift-default-594788f864-qggd6 to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh to ip-10-0-131-215.ec2.internal

openshift-ingress

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b to ip-10-0-132-175.ec2.internal

openshift-ingress

kube-auth-proxy-59d7d88d64-m5zd6

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-59d7d88d64-m5zd6 to ip-10-0-132-175.ec2.internal

openshift-ingress

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7 to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

Scheduled

Successfully assigned openshift-ingress/e2e-derive-320efe75-openshift-default-7985f8745b-r47x6 to ip-10-0-131-215.ec2.internal

openshift-ingress

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Scheduled

Successfully assigned openshift-ingress/e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf to ip-10-0-132-4.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-d7pgb to ip-10-0-131-215.ec2.internal

openshift-ingress

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4 to ip-10-0-131-215.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-t8dqw

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-t8dqw to ip-10-0-131-215.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-a84f90-89b6847d5-4458j to ip-10-0-132-175.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-5m597

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-5m597 to ip-10-0-132-175.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q to ip-10-0-131-215.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9 to ip-10-0-132-175.ec2.internal

openshift-ingress

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht to ip-10-0-131-215.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk to ip-10-0-132-4.ec2.internal

openshift-ingress

router-default-7447dd5b74-p7pm5

Scheduled

Successfully assigned openshift-ingress/router-default-7447dd5b74-p7pm5 to ip-10-0-131-215.ec2.internal

openshift-ingress

router-default-7447dd5b74-p7pm5

FailedScheduling

0/1 nodes are available: 1 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t to ip-10-0-132-175.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74 to ip-10-0-132-175.ec2.internal

openshift-ingress

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb to ip-10-0-131-215.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-t4whn

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-t4whn to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq to ip-10-0-132-4.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-qppls

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-qppls to ip-10-0-132-4.ec2.internal

openshift-ingress

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7 to ip-10-0-131-215.ec2.internal

openshift-ingress

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Scheduled

Successfully assigned openshift-ingress/e2e-autores-908959-openshift-default-f468d74f8-hl98x to ip-10-0-131-215.ec2.internal

openshift-ingress

payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh to ip-10-0-132-175.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9 to ip-10-0-132-4.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg to ip-10-0-132-4.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-7447dd5b74 from 0 to 1
(x9)

openshift-ingress

replicaset-controller

router-default-7447dd5b74

FailedCreate

Error creating: pods "router-default-7447dd5b74-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-7447dd5b74

FailedCreate

Error creating: pods "router-default-7447dd5b74-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-7447dd5b74

SuccessfulCreate

Created pod: router-default-7447dd5b74-p7pm5
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-7447dd5b74-p7pm5

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-7447dd5b74-p7pm5

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-7447dd5b74-p7pm5

AddedInterface

Add eth0 [10.132.0.7/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-7447dd5b74-p7pm5

Started

Started container router

openshift-ingress

kubelet

router-default-7447dd5b74-p7pm5

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-7447dd5b74-p7pm5

Created

Created container: router
(x4)

openshift-ingress

replicaset-controller

kube-auth-proxy-59d7d88d64

FailedCreate

Error creating: pods "kube-auth-proxy-59d7d88d64-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-59d7d88d64

SuccessfulCreate

Created pod: kube-auth-proxy-59d7d88d64-m5zd6

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-59d7d88d64 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-59d7d88d64

SuccessfulCreate

Created pod: kube-auth-proxy-59d7d88d64-pvnz2

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-pvnz2

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-m5zd6

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-59d7d88d64-m5zd6

AddedInterface

Add eth0 [10.134.0.20/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-t8dqw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

multus

kube-auth-proxy-59d7d88d64-pvnz2

AddedInterface

Add eth0 [10.132.0.26/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-t8dqw

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-pvnz2

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.732s (2.732s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-m5zd6

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-pvnz2

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-pvnz2

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-m5zd6

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 2.723s (2.723s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-59d7d88d64-m5zd6

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.461s (3.461s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

Started

Started container discovery

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 0 to 1

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-68cf4d799c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-68cf4d799c from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.684s (2.684s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.622s (2.622s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-68cf4d799c8l5sl

Started

Started container istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Started

Started container istio-proxy

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled down replica set data-science-gateway-data-science-gateway-class-fddd6c88c from 1 to 0

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-fddd6c88c

SuccessfulDelete

Deleted pod: data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-fddd6c88c-tn2zg

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-qppls

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-qppls

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qppls

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qppls

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qppls

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qppls

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.598s (2.598s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qppls

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-qppls

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-t8dqw

Killing

Stopping container discovery

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-t8dqw

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x4)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-5ccb968c66

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-5ccb968c66-d7pgb

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-5ccb968c66 from 0 to 1

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.709s (2.709s including waiting). Image size: 181318953 bytes.

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5m597

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-5m597

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-t4whn

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t4whn

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-5m597

openshift-ingress

multus

payload-processing-5b54b7fbb7-t4whn

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5m597

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t4whn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t4whn

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.707s (1.708s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5m597

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-5m597

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 1.853s (1.853s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-t4whn

Started

Started container payload-processing

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

ProbeError

Startup probe error: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-5ccb968c66-d7pgb

Unhealthy

Startup probe failed: Get "http://10.132.0.36:15021/healthz/ready": dial tcp 10.132.0.36:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-inf-a-1038cd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-1038cd

openshift-ingress

deployment-controller

e2e-inf-a-1038cd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-1038cd-openshift-default-594788f864 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-1038cd-openshift-default-594788f864

SuccessfulCreate

Created pod: e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-1038cd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-1038cd-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-1038cd-authn-ssl" already exists

openshift-ingress

multus

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1038cd-588f96c9f9

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1038cd-6785489774

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-1038cd-6785489774-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1038cd: serviceaccount "payload-processing-e2e-inf-a-1038cd" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-1038cd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-1038cd-6785489774 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-1038cd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-1038cd-588f96c9f9 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-1038cd-588f96c9f9

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-1038cd-588f96c9f9-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-1038cd: serviceaccount "payload-processing-e2e-inf-a-1038cd" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-1038cd-6785489774

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-ait-64f80f33-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-64f80f33-openshift-default-7b755d8fb from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-64f80f33-openshift-default-7b755d8fb

SuccessfulCreate

Created pod: e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

openshift-ingress

multus

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ait-64f80f33

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-64f80f33

openshift-ingress

deployment-controller

e2e-autores-908959-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-908959-openshift-default-f468d74f8 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-908959

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-908959

openshift-ingress

replicaset-controller

e2e-autores-908959-openshift-default-f468d74f8

SuccessfulCreate

Created pod: e2e-autores-908959-openshift-default-f468d74f8-hl98x

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-64f80f33

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-64f80f33-779b88cb6b from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-64f80f33: serviceaccount "payload-processing-e2e-ait-64f80f33" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-64f80f33-85996c85f5

FailedCreate

Error creating: pods "payload-processing-e2e-ait-64f80f33-85996c85f5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-64f80f33: serviceaccount "payload-processing-e2e-ait-64f80f33" not found

openshift-ingress

multus

e2e-autores-908959-openshift-default-f468d74f8-hl98x

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-64f80f33

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-64f80f33-85996c85f5 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-64f80f33-85996c85f5

SuccessfulCreate

Created pod: payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

openshift-ingress

kubelet

payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-908959

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-908959-bb85d8f58 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-autores-908959

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-908959-b84ff9dd5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-908959-b84ff9dd5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-908959-b84ff9dd5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-908959-b84ff9dd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-908959: serviceaccount "payload-processing-e2e-autores-908959" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-908959-bb85d8f58

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-908959-bb85d8f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-908959: serviceaccount "payload-processing-e2e-autores-908959" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-908959-bb85d8f58

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

openshift-ingress

kubelet

payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9

AddedInterface

Add eth0 [10.133.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

ProbeError

Readiness probe error: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Unhealthy

Readiness probe failed: Get "http://10.133.0.42:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

ProbeError

Readiness probe error: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Unhealthy

Readiness probe failed: Get "http://10.133.0.46:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x5)

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Unhealthy

Startup probe failed: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

ProbeError

Startup probe error: Get "http://10.133.0.42:15021/healthz/ready": dial tcp 10.133.0.42:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Started

Started container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-inf-b-a8da4e

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-a8da4e

openshift-ingress

deployment-controller

e2e-inf-b-a8da4e-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-a8da4e-openshift-default-6d4f94f54 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-a8da4e-openshift-default-6d4f94f54

SuccessfulCreate

Created pod: e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-a8da4e

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm
(x2)

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-a8da4e

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-a8da4e-7b5774948f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a8da4e-7b5774948f

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-a8da4e-7b5774948f

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-a8da4e-7b5774948f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a8da4e: serviceaccount "payload-processing-e2e-inf-b-a8da4e" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-a8da4e: serviceaccount "payload-processing-e2e-inf-b-a8da4e" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

ProbeError

Startup probe error: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Unhealthy

Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

AddedInterface

Add eth0 [10.133.0.51/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Unhealthy

Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

ProbeError

Startup probe error: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-64f80f33-779b88cb6b-rjhwf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ait-64f80f33-openshift-default-7b755d8fb-zrfbt

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ait-64f80f33-85996c85f5-5mnxh

Killing

Stopping container payload-processing

openshift-ingress

deployment-controller

e2e-migrate-e1915828-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-e1915828-gw-openshift-default-b4784c8d8 from 0 to 1

openshift-ingress

replicaset-controller

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8

SuccessfulCreate

Created pod: e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

openshift-ingress

gateway_labeler_controller

e2e-migrate-e1915828-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-e1915828-gw

openshift-ingress

multus

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

Started

Started container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-e1915828

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e1915828: serviceaccount "payload-processing-e2e-migrate-e1915828" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-e1915828

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-e1915828-6bfdb7bfc8 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-e1915828: serviceaccount "payload-processing-e2e-migrate-e1915828" not found

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

AddedInterface

Add eth0 [10.133.0.53/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Unhealthy

Readiness probe failed: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:35750->10.132.0.51:15021: read: connection reset by peer
(x2)

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

ProbeError

Readiness probe error: Get "http://10.132.0.51:15021/healthz/ready": read tcp 10.132.0.2:35750->10.132.0.51:15021: read: connection reset by peer body:
(x2)

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

ProbeError

Startup probe error: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Unhealthy

Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-e1915828-5c6f85ffd-k5dqf

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-e1915828-6bfdb7bfc8-525g9

Killing

Stopping container payload-processing

openshift-ingress

replicaset-controller

e2e-ait-4d42cf5d-openshift-default-5bc668f64d

SuccessfulCreate

Created pod: e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

openshift-ingress

deployment-controller

e2e-ait-4d42cf5d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-4d42cf5d-openshift-default-5bc668f64d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ait-4d42cf5d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-4d42cf5d

openshift-ingress

kubelet

e2e-migrate-e1915828-gw-openshift-default-b4784c8d8-hnw4z

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

AddedInterface

Add eth0 [10.133.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-4d42cf5d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-4d42cf5d-848865df4c from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4d42cf5d-848865df4c

FailedCreate

Error creating: pods "payload-processing-e2e-ait-4d42cf5d-848865df4c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4d42cf5d: serviceaccount "payload-processing-e2e-ait-4d42cf5d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-4d42cf5d: serviceaccount "payload-processing-e2e-ait-4d42cf5d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-4d42cf5d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-4d42cf5d-d48b676b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-4d42cf5d-848865df4c

SuccessfulCreate

Created pod: payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

AddedInterface

Add eth0 [10.133.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-908959-b84ff9dd5-z2wd9

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-908959-bb85d8f58-jn5qn

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-autores-908959

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-autores-908959: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-autores-908959": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-autores-908959, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2d635769-81f2-4500-b162-3fb78d791556, UID in object meta:

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-explicit-a84f90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-a84f90-openshift-default-74f8c4556d from 0 to 1

openshift-ingress

replicaset-controller

e2e-explicit-a84f90-openshift-default-74f8c4556d

SuccessfulCreate

Created pod: e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

openshift-ingress

gateway_labeler_controller

e2e-explicit-a84f90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-a84f90

openshift-ingress

multus

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-autores-908959-openshift-default-f468d74f8-hl98x

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a84f90: serviceaccount "payload-processing-e2e-explicit-a84f90" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a84f90-89b6847d5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-a84f90-89b6847d5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-a84f90: serviceaccount "payload-processing-e2e-explicit-a84f90" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-a84f90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-a84f90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-a84f90-89b6847d5 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

AddedInterface

Add eth0 [10.133.0.59/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-a84f90-89b6847d5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

openshift-ingress

kubelet

payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

Unhealthy

Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

ProbeError

Startup probe error: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-4d42cf5d-d48b676b-2s9fk

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-4d42cf5d-848865df4c-jqrfq

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-4d42cf5d-openshift-default-5bc668f64d-9wwpb

Killing

Stopping container istio-proxy

openshift-ingress

replicaset-controller

e2e-derive-320efe75-openshift-default-7985f8745b

SuccessfulCreate

Created pod: e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

openshift-ingress

deployment-controller

e2e-derive-320efe75-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-320efe75-openshift-default-7985f8745b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-derive-320efe75

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-320efe75

openshift-ingress

multus

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-320efe75

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-320efe75-d676fdc6b from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-320efe75-d676fdc6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-320efe75-d676fdc6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-320efe75: serviceaccount "payload-processing-e2e-derive-320efe75" not found

openshift-ingress

deployment-controller

payload-processing-e2e-derive-320efe75

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-320efe75-589579586f from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-320efe75-589579586f

SuccessfulCreate

Created pod: payload-processing-e2e-derive-320efe75-589579586f-v5dnz
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-320efe75-589579586f

FailedCreate

Error creating: pods "payload-processing-e2e-derive-320efe75-589579586f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-320efe75: serviceaccount "payload-processing-e2e-derive-320efe75" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-320efe75-d676fdc6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Started

Started container istio-proxy

openshift-ingress

multus

payload-processing-e2e-derive-320efe75-589579586f-v5dnz

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-320efe75-589579586f-v5dnz

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-320efe75-589579586f-v5dnz

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-derive-320efe75-589579586f-v5dnz

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

ProbeError

Readiness probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:

openshift-ingress

multus

payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Unhealthy

Readiness probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

ProbeError

Startup probe error: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Unhealthy

Startup probe failed: Get "http://10.132.0.54:15021/healthz/ready": dial tcp 10.132.0.54:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

ProbeError

Startup probe error: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

Unhealthy

Startup probe failed: Get "http://10.132.0.55:15021/healthz/ready": dial tcp 10.132.0.55:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-320efe75-589579586f-v5dnz

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-derive-320efe75-openshift-default-7985f8745b-r47x6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-320efe75-d676fdc6b-7mcvl

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-a84f90-89b6847d5-4458j

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-a84f90-6bbdc768f8-4524f

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-a84f90-openshift-default-74f8c4556d-bzcrh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-noten-860c6d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-860c6d

openshift-ingress

deployment-controller

e2e-noten-860c6d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-860c6d-openshift-default-57cd778746 from 0 to 1

openshift-ingress

replicaset-controller

e2e-noten-860c6d-openshift-default-57cd778746

SuccessfulCreate

Created pod: e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

openshift-ingress

kubelet

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

multus

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-860c6d-openshift-default-57cd778746-j8wcp

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-inf-a-1038cd

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-inf-a-1038cd": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-inf-a-1038cd, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 0210c621-5304-4301-9f45-03566f2fcc7d, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-inf-a-1038cd-588f96c9f9-prwl4

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-1038cd-6785489774-t66c4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-a-1038cd-openshift-default-594788f864-qggd6

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-b-a8da4e-7b5774948f-6957b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-a8da4e-fc4ffddfd-5zzgm

Unhealthy

Readiness probe failed: dial tcp 10.133.0.51:9004: connect: connection refused

openshift-ingress

multus

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

AddedInterface

Add eth0 [10.133.0.68/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-a5a838b2-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-a5a838b2-openshift-default-ccdc7b4f6 from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6

SuccessfulCreate

Created pod: e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

openshift-ingress

gateway_labeler_controller

e2e-mt-a5a838b2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-a5a838b2

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

AddedInterface

Add eth0 [10.133.0.69/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-a5a838b2

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

openshift-ingress

kubelet

payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

AddedInterface

Add eth0 [10.133.0.70/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5a838b2-69c469bc57

FailedCreate

Error creating: pods "payload-processing-e2e-mt-a5a838b2-69c469bc57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5a838b2: serviceaccount "payload-processing-e2e-mt-a5a838b2" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-a5a838b2-69c469bc57

SuccessfulCreate

Created pod: payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

openshift-ingress

deployment-controller

payload-processing-e2e-mt-a5a838b2

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-a5a838b2-69c469bc57 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-a5a838b2: serviceaccount "payload-processing-e2e-mt-a5a838b2" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-a8da4e-openshift-default-6d4f94f54-vxzt7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

Started

Started container payload-processing

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-b8cea6

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-b8cea6

openshift-ingress

deployment-controller

e2e-shared-a-w3-b8cea6-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd from 0 to 1

openshift-ingress

multus

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd

SuccessfulCreate

Created pod: e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b8cea6: serviceaccount "payload-processing-e2e-shared-a-w3-b8cea6" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-b8cea6

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-b8cea6

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-b8cea6: serviceaccount "payload-processing-e2e-shared-a-w3-b8cea6" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

AddedInterface

Add eth0 [10.133.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Unhealthy

Readiness probe failed: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

ProbeError

Readiness probe error: Get "http://10.133.0.68:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

ProbeError

Readiness probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Unhealthy

Startup probe failed: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Unhealthy

Readiness probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

ProbeError

Startup probe error: Get "http://10.133.0.68:15021/healthz/ready": dial tcp 10.133.0.68:15021: connect: connection refused body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

ProbeError

Startup probe error: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Unhealthy

Startup probe failed: Get "http://10.132.0.59:15021/healthz/ready": dial tcp 10.132.0.59:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w3-434d57-openshift-default-5575cb964d

SuccessfulCreate

Created pod: e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

openshift-ingress

deployment-controller

e2e-shared-b-w3-434d57-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-434d57-openshift-default-5575cb964d from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-434d57

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-434d57

openshift-ingress

multus

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-434d57: serviceaccount "payload-processing-e2e-shared-b-w3-434d57" not found

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

AddedInterface

Add eth0 [10.133.0.74/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-434d57

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-434d57: serviceaccount "payload-processing-e2e-shared-b-w3-434d57" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-434d57

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-a5a838b2-69c469bc57-m5976

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-a5a838b2-86cdc6b678-zgdvs

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-a5a838b2-openshift-default-ccdc7b4f6-mmpf9

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused

openshift-ingress

multus

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

AddedInterface

Add eth0 [10.133.0.76/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4

SuccessfulCreate

Created pod: e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

openshift-ingress

deployment-controller

e2e-shared-a-w2-747fee-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-747fee

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-747fee
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-747fee-66566c8f57

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-747fee-66566c8f57-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-747fee: serviceaccount "payload-processing-e2e-shared-a-w2-747fee" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-747fee: serviceaccount "payload-processing-e2e-shared-a-w2-747fee" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-747fee

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-747fee-66566c8f57

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-747fee

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-747fee-66566c8f57 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

Started

Started container payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

AddedInterface

Add eth0 [10.133.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Unhealthy

Readiness probe failed: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

ProbeError

Readiness probe error: Get "http://10.133.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

ProbeError

Startup probe error: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Unhealthy

Startup probe failed: Get "http://10.133.0.76:15021/healthz/ready": dial tcp 10.133.0.76:15021: connect: connection refused

openshift-ingress

replicaset-controller

e2e-shared-b-w2-a89024-openshift-default-678d9f4984

SuccessfulCreate

Created pod: e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-a89024

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-a89024

openshift-ingress

deployment-controller

e2e-shared-b-w2-a89024-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-a89024-openshift-default-678d9f4984 from 0 to 1

openshift-ingress

multus

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

AddedInterface

Add eth0 [10.133.0.79/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a89024: serviceaccount "payload-processing-e2e-shared-b-w2-a89024" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-a89024

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a89024-5d974c4567

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-a89024-5d974c4567-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-a89024: serviceaccount "payload-processing-e2e-shared-b-w2-a89024" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-a89024

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-a89024-5d974c4567 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-a89024-5d974c4567

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Unhealthy

Readiness probe failed: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

ProbeError

Readiness probe error: Get "http://10.133.0.79:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Unhealthy

Startup probe failed: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

ProbeError

Startup probe error: Get "http://10.133.0.79:15021/healthz/ready": dial tcp 10.133.0.79:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-mt-107fc16f-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-107fc16f-openshift-default-7cf76cbc64 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-mt-107fc16f

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-107fc16f

openshift-ingress

replicaset-controller

e2e-mt-107fc16f-openshift-default-7cf76cbc64

SuccessfulCreate

Created pod: e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

openshift-ingress

multus

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-107fc16f-7996c68685

FailedCreate

Error creating: pods "payload-processing-e2e-mt-107fc16f-7996c68685-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-107fc16f: serviceaccount "payload-processing-e2e-mt-107fc16f" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-107fc16f: serviceaccount "payload-processing-e2e-mt-107fc16f" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-107fc16f

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-107fc16f-84c775fd5d from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-107fc16f-7996c68685

SuccessfulCreate

Created pod: payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

openshift-ingress

deployment-controller

payload-processing-e2e-mt-107fc16f

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-107fc16f-7996c68685 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

AddedInterface

Add eth0 [10.133.0.81/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x

AddedInterface

Add eth0 [10.133.0.80/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

Started

Started container istio-proxy
(x7)

openshift-ingress

kubelet

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

ProbeError

Startup probe error: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused body:
(x7)

openshift-ingress

kubelet

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

Unhealthy

Startup probe failed: Get "http://10.132.0.66:15021/healthz/ready": dial tcp 10.132.0.66:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-107fc16f-7996c68685-ttdtw

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-107fc16f

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-107fc16f: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-107fc16f": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-107fc16f, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: deb7a778-a90b-470f-8177-f945efaf80e9, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-107fc16f-84c775fd5d-mxn8x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-107fc16f-openshift-default-7cf76cbc64-cwv8k

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-api-a-467e44-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-467e44-openshift-default-7d7bd4988d from 0 to 1

openshift-ingress

replicaset-controller

e2e-api-a-467e44-openshift-default-7d7bd4988d

SuccessfulCreate

Created pod: e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

openshift-ingress

gateway_labeler_controller

e2e-api-a-467e44

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-467e44

openshift-ingress

multus

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-467e44-59445b5cdc

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-467e44-59445b5cdc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-467e44: serviceaccount "payload-processing-e2e-api-a-467e44" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-467e44-77c8c9b554

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-467e44-77c8c9b554

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-467e44-77c8c9b554-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-467e44: serviceaccount "payload-processing-e2e-api-a-467e44" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-467e44

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-467e44-77c8c9b554 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-467e44

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-467e44-59445b5cdc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-467e44-59445b5cdc

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

openshift-ingress

multus

payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

AddedInterface

Add eth0 [10.133.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

Created

Created container: istio-proxy

openshift-ingress

deployment-controller

e2e-api-b-cf1797-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-cf1797-openshift-default-7ddf96f9cb from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-cf1797

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-cf1797

openshift-ingress

replicaset-controller

e2e-api-b-cf1797-openshift-default-7ddf96f9cb

SuccessfulCreate

Created pod: e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

openshift-ingress

multus

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

ProbeError

Startup probe error: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

Unhealthy

Startup probe failed: Get "http://10.132.0.69:15021/healthz/ready": dial tcp 10.132.0.69:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-cf1797

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-cf1797-69d587b498 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-cf1797

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-cf1797-c898b8b67 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cf1797-c898b8b67

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-cf1797-c898b8b67

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-cf1797-c898b8b67-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cf1797: serviceaccount "payload-processing-e2e-api-b-cf1797" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cf1797-69d587b498

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-cf1797-69d587b498

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-cf1797-69d587b498-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-cf1797: serviceaccount "payload-processing-e2e-api-b-cf1797" not found

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml

AddedInterface

Add eth0 [10.133.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

ProbeError

Startup probe error: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Unhealthy

Startup probe failed: Get "http://10.132.0.73:15021/healthz/ready": dial tcp 10.132.0.73:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-467e44-77c8c9b554-wfffb

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-api-a-467e44

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-api-a-467e44: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-api-a-467e44": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-api-a-467e44, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 7caa38e0-edb4-402d-b722-94e338f23ce3, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-api-a-467e44-59445b5cdc-xfcqk

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-467e44-openshift-default-7d7bd4988d-kxbht

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-cf1797-69d587b498-d86ks

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-cf1797-c898b8b67-2wkml

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-api-b-cf1797-openshift-default-7ddf96f9cb-bqmkb

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-747fee-6bccf85d6b-ww5g5

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-747fee-66566c8f57-4z8lp

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-747fee

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-747fee": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-747fee, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5545e276-20ce-487a-95d5-1bbcd7075a84, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-747fee-openshift-default-6599dfcdc4-xhmpv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-a89024-5d974c4567-7sx4t

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-a89024-c9596ddbb-fhnd9

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4

SuccessfulCreate

Created pod: e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

openshift-ingress

deployment-controller

e2e-ipp-a-f8fdfa-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-f8fdfa

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-f8fdfa

openshift-ingress

multus

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-b-w2-a89024-openshift-default-678d9f4984-6htqk

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-f8fdfa

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-f8fdfa

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa: serviceaccount "payload-processing-e2e-ipp-a-f8fdfa" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-f8fdfa: serviceaccount "payload-processing-e2e-ipp-a-f8fdfa" not found

openshift-ingress

multus

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr

AddedInterface

Add eth0 [10.133.0.92/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd

AddedInterface

Add eth0 [10.133.0.91/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

ProbeError

Readiness probe error: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Unhealthy

Readiness probe failed: Get "http://10.132.0.74:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

ProbeError

Startup probe error: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Unhealthy

Startup probe failed: Get "http://10.132.0.74:15021/healthz/ready": dial tcp 10.132.0.74:15021: connect: connection refused

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-704b16

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-704b16

openshift-ingress

deployment-controller

e2e-ipp-b-704b16-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-704b16-openshift-default-589d749b64 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-b-704b16-openshift-default-589d749b64

SuccessfulCreate

Created pod: e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

openshift-ingress

multus

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

AddedInterface

Add eth0 [10.133.0.93/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-704b16-6d5db56675

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-704b16-766c48669d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-704b16-766c48669d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-704b16: serviceaccount "payload-processing-e2e-ipp-b-704b16" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-704b16

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-704b16-766c48669d from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-704b16-6d5db56675

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-704b16-6d5db56675-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-704b16: serviceaccount "payload-processing-e2e-ipp-b-704b16" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-704b16

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-704b16-6d5db56675 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-704b16-766c48669d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94

AddedInterface

Add eth0 [10.133.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

ProbeError

Readiness probe error: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Unhealthy

Readiness probe failed: Get "http://10.133.0.93:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Unhealthy

Startup probe failed: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

ProbeError

Startup probe error: Get "http://10.133.0.93:15021/healthz/ready": dial tcp 10.133.0.93:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-c5ce6a

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-c5ce6a

openshift-ingress

deployment-controller

e2e-ipp-cleanup-c5ce6a-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd

SuccessfulCreate

Created pod: e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

openshift-ingress

multus

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-c5ce6a

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a: serviceaccount "payload-processing-e2e-ipp-cleanup-c5ce6a" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-c5ce6a: serviceaccount "payload-processing-e2e-ipp-cleanup-c5ce6a" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-c5ce6a

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

AddedInterface

Add eth0 [10.133.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

ProbeError

Readiness probe error: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Unhealthy

Readiness probe failed: Get "http://10.132.0.76:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Unhealthy

Startup probe failed: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

ProbeError

Startup probe error: Get "http://10.132.0.76:15021/healthz/ready": dial tcp 10.132.0.76:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-c5ce6a-79cc675ff4-vgv94

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-c5ce6a-58f6b88f-x4tqg

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-c5ce6a-openshift-default-988b56dcd-pst9q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-f8fdfa-66785f54d6-xxjmd

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-a-f8fdfa

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-a-f8fdfa": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-a-f8fdfa, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 35561909-d340-4fd9-ac22-61a0169e6ec2, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-f8fdfa-5fff6db5d7-zl7mr

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ipp-a-f8fdfa-openshift-default-5c78554dd4-nj9s4

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-704b16-766c48669d-wmwlj

Killing

Stopping container payload-pre-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-704b16

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-704b16: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-704b16": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-704b16, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 5155bb06-be35-424f-a5e0-1bedb7def4f1, UID in object meta:

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-704b16-6d5db56675-fzc94

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ipp-b-704b16-openshift-default-589d749b64-bs6dg

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-b8cea6-f57bcddfc-4lp74

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-b8cea6-bb446469d-plrnx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w3-b8cea6-openshift-default-bb4946cd-vlpx7

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-434d57-85f79bfcd7-db8vt

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-434d57-6fdf76666-mqqph

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-b-w3-434d57-openshift-default-5575cb964d-lr4pj

Killing

Stopping container istio-proxy