Time Namespace Component RelatedObject Reason Message

openshift-ingress

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79 to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn to ip-10-0-136-127.ec2.internal

openshift-ingress

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb to ip-10-0-139-41.ec2.internal

openshift-ingress

data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

Scheduled

Successfully assigned openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb to ip-10-0-136-127.ec2.internal

openshift-ingress

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Scheduled

Successfully assigned openshift-ingress/e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6 to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49 to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-59fbc47bf8-wmp6c

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-59fbc47bf8-wmp6c to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-5b54b7fbb7-5mkwm

Scheduled

Successfully assigned openshift-ingress/payload-processing-5b54b7fbb7-5mkwm to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5 to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

Scheduled

Successfully assigned openshift-ingress/e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l to ip-10-0-133-187.ec2.internal

openshift-ingress

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Scheduled

Successfully assigned openshift-ingress/e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7 to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Scheduled

Successfully assigned openshift-ingress/e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8 to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4 to ip-10-0-136-127.ec2.internal

openshift-ingress

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Scheduled

Successfully assigned openshift-ingress/e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g to ip-10-0-139-41.ec2.internal

openshift-ingress

kube-auth-proxy-7f8d66d765-tr8qv

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f8d66d765-tr8qv to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

Scheduled

Successfully assigned openshift-ingress/e2e-noten-536240-openshift-default-5b558f7c56-t9hlh to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99 to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

Scheduled

Successfully assigned openshift-ingress/e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Scheduled

Successfully assigned openshift-ingress/e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Scheduled

Successfully assigned openshift-ingress/e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2 to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Scheduled

Successfully assigned openshift-ingress/e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x to ip-10-0-136-127.ec2.internal

openshift-ingress

kube-auth-proxy-7f8d66d765-ftb49

Scheduled

Successfully assigned openshift-ingress/kube-auth-proxy-7f8d66d765-ftb49 to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Scheduled

Successfully assigned openshift-ingress/e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89 to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69 to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7 to ip-10-0-136-127.ec2.internal

openshift-ingress

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq to ip-10-0-136-127.ec2.internal

openshift-ingress

istiod-openshift-gateway-7b7995d5cd-mthft

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mthft to ip-10-0-133-187.ec2.internal

openshift-ingress

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

Scheduled

Successfully assigned openshift-ingress/e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr to ip-10-0-133-187.ec2.internal

openshift-ingress

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

Scheduled

Successfully assigned openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4bzvt to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9 to ip-10-0-139-41.ec2.internal

openshift-ingress

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Scheduled

Successfully assigned openshift-ingress/e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8 to ip-10-0-136-127.ec2.internal

openshift-ingress

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Scheduled

Successfully assigned openshift-ingress/e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q to ip-10-0-139-41.ec2.internal

openshift-ingress

istiod-openshift-gateway-5677ccb49b-frt82

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-frt82 to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c to ip-10-0-139-41.ec2.internal

openshift-ingress

router-default-78d7dd88d4-wjvdt

Scheduled

Successfully assigned openshift-ingress/router-default-78d7dd88d4-wjvdt to ip-10-0-136-127.ec2.internal

openshift-ingress

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c to ip-10-0-136-127.ec2.internal

openshift-ingress

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Scheduled

Successfully assigned openshift-ingress/e2e-autores-a1721d-openshift-default-689f485974-7bh9h to ip-10-0-133-187.ec2.internal

openshift-ingress

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Scheduled

Successfully assigned openshift-ingress/e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs to ip-10-0-133-187.ec2.internal

openshift-ingress

payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k

Scheduled

Successfully assigned openshift-ingress/payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k to ip-10-0-139-41.ec2.internal

openshift-ingress

payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7

Scheduled

Successfully assigned openshift-ingress/payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7 to ip-10-0-136-127.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-78d7dd88d4 from 0 to 1
(x8)

openshift-ingress

replicaset-controller

router-default-78d7dd88d4

FailedCreate

Error creating: pods "router-default-78d7dd88d4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-78d7dd88d4

FailedCreate

Error creating: pods "router-default-78d7dd88d4-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-78d7dd88d4

SuccessfulCreate

Created pod: router-default-78d7dd88d4-wjvdt
(x5)

openshift-ingress

kubelet

router-default-78d7dd88d4-wjvdt

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-78d7dd88d4-wjvdt

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-78d7dd88d4-wjvdt

AddedInterface

Add eth0 [10.134.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-78d7dd88d4-wjvdt

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:da130d90f0bffd5c5876c94544c91b2a1be0d23ce2747ddfeafe88e03ee7d8d1" already present on machine

openshift-ingress

kubelet

router-default-78d7dd88d4-wjvdt

Created

Created container: router

openshift-ingress

kubelet

router-default-78d7dd88d4-wjvdt

Started

Started container router

openshift-ingress

deployment-controller

kube-auth-proxy

ScalingReplicaSet

Scaled up replica set kube-auth-proxy-7f8d66d765 from 0 to 2

openshift-ingress

replicaset-controller

kube-auth-proxy-7f8d66d765

SuccessfulCreate

Created pod: kube-auth-proxy-7f8d66d765-tr8qv

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-tr8qv

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found
(x5)

openshift-ingress

replicaset-controller

kube-auth-proxy-7f8d66d765

FailedCreate

Error creating: pods "kube-auth-proxy-7f8d66d765-" is forbidden: error looking up service account openshift-ingress/kube-auth-proxy: serviceaccount "kube-auth-proxy" not found

openshift-ingress

replicaset-controller

kube-auth-proxy-7f8d66d765

SuccessfulCreate

Created pod: kube-auth-proxy-7f8d66d765-ftb49

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-ftb49

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "kube-auth-proxy-tls" not found

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-tr8qv

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-ftb49

Pulling

Pulling image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2"

openshift-ingress

multus

kube-auth-proxy-7f8d66d765-ftb49

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7b7995d5cd-mthft

openshift-ingress

multus

kube-auth-proxy-7f8d66d765-tr8qv

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

openshift-ingress

multus

istiod-openshift-gateway-7b7995d5cd-mthft

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31"

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-ftb49

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.237s (3.237s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-ftb49

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-tr8qv

Pulled

Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy:v3.5.0-ea.2" in 3.333s (3.333s including waiting). Image size: 265120132 bytes.

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-tr8qv

Created

Created container: kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-tr8qv

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

kube-auth-proxy-7f8d66d765-ftb49

Started

Started container kube-auth-proxy

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.637s (3.637s including waiting). Image size: 181126104 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

replicaset-controller

data-science-gateway-data-science-gateway-class-d66cd8c7c

SuccessfulCreate

Created pod: data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

openshift-ingress

multus

data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

openshift-ingress

deployment-controller

data-science-gateway-data-science-gateway-class

ScalingReplicaSet

Scaled up replica set data-science-gateway-data-science-gateway-class-d66cd8c7c from 0 to 1

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.612s (4.612s including waiting). Image size: 181318953 bytes.

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

Created

Created container: istio-proxy

openshift-ingress

kubelet

data-science-gateway-data-science-gateway-class-d66cd8c7c-l9zmb

Started

Started container istio-proxy

openshift-ingress

replicaset-controller

istiod-openshift-gateway-5677ccb49b

SuccessfulCreate

Created pod: istiod-openshift-gateway-5677ccb49b-frt82

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1

openshift-ingress

multus

istiod-openshift-gateway-5677ccb49b-frt82

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-frt82

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-frt82

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" already present on machine

openshift-ingress

kubelet

istiod-openshift-gateway-5677ccb49b-frt82

Started

Started container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7b7995d5cd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7b7995d5cd-mthft

openshift-ingress

kubelet

istiod-openshift-gateway-7b7995d5cd-mthft

Killing

Stopping container discovery
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

kube-auth-proxy

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready)

openshift-ingress

deployment-controller

maas-default-gateway-openshift-default

ScalingReplicaSet

Scaled up replica set maas-default-gateway-openshift-default-78bb78ff78 from 0 to 1

openshift-ingress

multus

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

maas-default-gateway

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway maas-default-gateway

openshift-ingress

replicaset-controller

maas-default-gateway-openshift-default-78bb78ff78

SuccessfulCreate

Created pod: maas-default-gateway-openshift-default-78bb78ff78-4bzvt

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

SuccessfulCreate

Created pod: payload-pre-processing-59fbc47bf8-wmp6c

openshift-ingress

deployment-controller

payload-processing

ScalingReplicaSet

Scaled up replica set payload-processing-5b54b7fbb7 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

FailedCreate

Error creating: pods "payload-processing-5b54b7fbb7-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-59fbc47bf8

FailedCreate

Error creating: pods "payload-pre-processing-59fbc47bf8-" is forbidden: error looking up service account openshift-ingress/payload-processing: serviceaccount "payload-processing" not found

openshift-ingress

deployment-controller

payload-pre-processing

ScalingReplicaSet

Scaled up replica set payload-pre-processing-59fbc47bf8 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-5b54b7fbb7

SuccessfulCreate

Created pod: payload-processing-5b54b7fbb7-5mkwm

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5mkwm

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wmp6c

Pulling

Pulling image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable"

openshift-ingress

multus

payload-pre-processing-59fbc47bf8-wmp6c

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-5b54b7fbb7-5mkwm

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wmp6c

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wmp6c

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-59fbc47bf8-wmp6c

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 2.522s (2.522s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5mkwm

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5mkwm

Pulled

Successfully pulled image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" in 4.521s (4.521s including waiting). Image size: 166449337 bytes.

openshift-ingress

kubelet

payload-processing-5b54b7fbb7-5mkwm

Started

Started container payload-processing
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

ProbeError

Startup probe error: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

maas-default-gateway-openshift-default-78bb78ff78-4bzvt

Unhealthy

Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused

openshift-ingress

GatewayAuthBootstrap

e2e-inf-a-95669b

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-inf-a-95669b-authn-ssl: envoyfilters.networking.istio.io "e2e-inf-a-95669b-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-inf-a-95669b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-a-95669b

openshift-ingress

deployment-controller

e2e-inf-a-95669b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-a-95669b-openshift-default-559bbb4544 from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-a-95669b-openshift-default-559bbb4544

SuccessfulCreate

Created pod: e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

openshift-ingress

multus

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-inf-a-95669b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-a-95669b-84f6674b87 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

Started

Started container payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-a-95669b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-a-95669b-b88688fc4 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-95669b-84f6674b87

FailedCreate

Error creating: pods "payload-processing-e2e-inf-a-95669b-84f6674b87-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-95669b: serviceaccount "payload-processing-e2e-inf-a-95669b" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-a-95669b-84f6674b87

SuccessfulCreate

Created pod: payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

openshift-ingress

multus

payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

Created

Created container: payload-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-95669b-b88688fc4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-a-95669b-b88688fc4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-a-95669b-b88688fc4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-a-95669b: serviceaccount "payload-processing-e2e-inf-a-95669b" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k

Created

Created container: payload-pre-processing

openshift-ingress

GatewayAuthBootstrap

e2e-ait-7d3a6048

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-ait-7d3a6048-authn-ssl: envoyfilters.networking.istio.io "e2e-ait-7d3a6048-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-ait-7d3a6048

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-7d3a6048

openshift-ingress

deployment-controller

e2e-ait-7d3a6048-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-7d3a6048-openshift-default-c8fdfd478 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-7d3a6048-openshift-default-c8fdfd478

SuccessfulCreate

Created pod: e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

openshift-ingress

multus

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-autores-a1721d-openshift-default-689f485974

SuccessfulCreate

Created pod: e2e-autores-a1721d-openshift-default-689f485974-7bh9h

openshift-ingress

deployment-controller

e2e-autores-a1721d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-autores-a1721d-openshift-default-689f485974 from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-autores-a1721d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-autores-a1721d

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec"

openshift-ingress

multus

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

AddedInterface

Add eth0 [10.133.0.50/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-7d3a6048

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858 from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7d3a6048: serviceaccount "payload-processing-e2e-ait-7d3a6048" not found

openshift-ingress

deployment-controller

payload-processing-e2e-ait-7d3a6048

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-7d3a6048-5dfbb4c477 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7d3a6048-5dfbb4c477

FailedCreate

Error creating: pods "payload-processing-e2e-ait-7d3a6048-5dfbb4c477-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-7d3a6048: serviceaccount "payload-processing-e2e-ait-7d3a6048" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-7d3a6048-5dfbb4c477

SuccessfulCreate

Created pod: payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 4.659s (4.659s including waiting). Image size: 181318953 bytes.
(x2)

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

ProbeError

Readiness probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Unhealthy

Readiness probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-autores-a1721d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-autores-a1721d-6457dcc9f4 from 0 to 1
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a1721d-5b494b4fb5

FailedCreate

Error creating: pods "payload-processing-e2e-autores-a1721d-5b494b4fb5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a1721d: serviceaccount "payload-processing-e2e-autores-a1721d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4

SuccessfulCreate

Created pod: payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

openshift-ingress

deployment-controller

payload-processing-e2e-autores-a1721d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-autores-a1721d-5b494b4fb5 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4

FailedCreate

Error creating: pods "payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-autores-a1721d: serviceaccount "payload-processing-e2e-autores-a1721d" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-autores-a1721d-5b494b4fb5

SuccessfulCreate

Created pod: payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

openshift-ingress

kubelet

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes
(x5)

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Unhealthy

Startup probe failed: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

ProbeError

Startup probe error: Get "http://10.134.0.38:15021/healthz/ready": dial tcp 10.134.0.38:15021: connect: connection refused body:

openshift-ingress

gateway_labeler_controller

e2e-inf-b-425b2c

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-inf-b-425b2c

openshift-ingress

deployment-controller

e2e-inf-b-425b2c-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-inf-b-425b2c-openshift-default-658cc4654d from 0 to 1

openshift-ingress

replicaset-controller

e2e-inf-b-425b2c-openshift-default-658cc4654d

SuccessfulCreate

Created pod: e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

openshift-ingress

multus

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

AddedInterface

Add eth0 [10.133.0.52/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-425b2c-798c74d9bc

SuccessfulCreate

Created pod: payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-inf-b-425b2c-798c74d9bc

FailedCreate

Error creating: pods "payload-processing-e2e-inf-b-425b2c-798c74d9bc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-425b2c: serviceaccount "payload-processing-e2e-inf-b-425b2c" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-inf-b-425b2c

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-inf-b-425b2c-854978865d from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-inf-b-425b2c

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-inf-b-425b2c-798c74d9bc from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-425b2c-854978865d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-inf-b-425b2c-854978865d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-inf-b-425b2c-854978865d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-inf-b-425b2c: serviceaccount "payload-processing-e2e-inf-b-425b2c" not found

openshift-ingress

multus

payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c

Created

Created container: payload-processing
(x5)

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

ProbeError

Startup probe error: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Unhealthy

Startup probe failed: Get "http://10.134.0.40:15021/healthz/ready": dial tcp 10.134.0.40:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

ProbeError

Startup probe error: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Unhealthy

Startup probe failed: Get "http://10.133.0.50:15021/healthz/ready": dial tcp 10.133.0.50:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-7d3a6048-78b9fbf858-p75vc

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-7d3a6048-5dfbb4c477-l2l7z

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ait-7d3a6048-openshift-default-c8fdfd478-skp5d

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548

SuccessfulCreate

Created pod: e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

openshift-ingress

gateway_labeler_controller

e2e-migrate-ac040d69-gw

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-migrate-ac040d69-gw

openshift-ingress

deployment-controller

e2e-migrate-ac040d69-gw-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-migrate-ac040d69-gw-openshift-default-6b5656c548 from 0 to 1
(x5)

openshift-ingress

kubelet

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

ProbeError

Startup probe error: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

Unhealthy

Startup probe failed: Get "http://10.133.0.52:15021/healthz/ready": dial tcp 10.133.0.52:15021: connect: connection refused

openshift-ingress

deployment-controller

payload-pre-processing-e2e-migrate-ac040d69

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ac040d69-85f5fb9f58

FailedCreate

Error creating: pods "payload-processing-e2e-migrate-ac040d69-85f5fb9f58-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ac040d69: serviceaccount "payload-processing-e2e-migrate-ac040d69" not found
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-migrate-ac040d69: serviceaccount "payload-processing-e2e-migrate-ac040d69" not found

openshift-ingress

deployment-controller

payload-processing-e2e-migrate-ac040d69

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-migrate-ac040d69-85f5fb9f58 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

openshift-ingress

replicaset-controller

payload-processing-e2e-migrate-ac040d69-85f5fb9f58

SuccessfulCreate

Created pod: payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

ProbeError

Readiness probe error: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Unhealthy

Readiness probe failed: Get "http://10.134.0.43:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

ProbeError

Startup probe error: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Unhealthy

Startup probe failed: Get "http://10.134.0.43:15021/healthz/ready": dial tcp 10.134.0.43:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-migrate-ac040d69-85f5fb9f58-dt47k

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-migrate-ac040d69-7cfffdf7cd-4wlk7

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-migrate-ac040d69-gw-openshift-default-6b5656c548-7mdhb

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-ait-b16466d7

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ait-b16466d7

openshift-ingress

deployment-controller

e2e-ait-b16466d7-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ait-b16466d7-openshift-default-dd465fcd4 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ait-b16466d7-openshift-default-dd465fcd4

SuccessfulCreate

Created pod: e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

openshift-ingress

multus

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

AddedInterface

Add eth0 [10.133.0.56/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ait-b16466d7

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ait-b16466d7-6896757b95 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ait-b16466d7

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d from 0 to 1
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b16466d7: serviceaccount "payload-processing-e2e-ait-b16466d7" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

openshift-ingress

kubelet

payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

Created

Created container: payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b16466d7-6896757b95

FailedCreate

Error creating: pods "payload-processing-e2e-ait-b16466d7-6896757b95-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ait-b16466d7: serviceaccount "payload-processing-e2e-ait-b16466d7" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-ait-b16466d7-6896757b95

SuccessfulCreate

Created pod: payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

openshift-ingress

multus

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

ProbeError

Readiness probe error: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Unhealthy

Readiness probe failed: Get "http://10.133.0.56:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

ProbeError

Startup probe error: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Unhealthy

Startup probe failed: Get "http://10.133.0.56:15021/healthz/ready": dial tcp 10.133.0.56:15021: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-autores-a1721d-5b494b4fb5-plf89

Unhealthy

Readiness probe failed: dial tcp 10.132.0.40:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-autores-a1721d-6457dcc9f4-c4dgr

Unhealthy

Readiness probe failed: dial tcp 10.132.0.39:9004: connect: connection refused

openshift-ingress

kubelet

payload-pre-processing-e2e-ait-b16466d7-7f7b7d6f9d-jdw6x

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ait-b16466d7-6896757b95-fxbhb

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-derive-46564b9d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-derive-46564b9d

openshift-ingress

deployment-controller

e2e-derive-46564b9d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-derive-46564b9d-openshift-default-7888f5fbd from 0 to 1

openshift-ingress

replicaset-controller

e2e-derive-46564b9d-openshift-default-7888f5fbd

SuccessfulCreate

Created pod: e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

openshift-ingress

multus

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-ait-b16466d7-openshift-default-dd465fcd4-v2t8d

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused

openshift-ingress

gateway_labeler_controller

e2e-explicit-20cf96

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-explicit-20cf96
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-46564b9d-685c97f454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-derive-46564b9d-685c97f454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46564b9d: serviceaccount "payload-processing-e2e-derive-46564b9d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-derive-46564b9d-685c97f454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

openshift-ingress

deployment-controller

payload-pre-processing-e2e-derive-46564b9d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-derive-46564b9d-685c97f454 from 0 to 1

openshift-ingress

kubelet

e2e-autores-a1721d-openshift-default-689f485974-7bh9h

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

payload-processing-e2e-derive-46564b9d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-derive-46564b9d-655c47fbd5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-46564b9d-655c47fbd5

SuccessfulCreate

Created pod: payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-derive-46564b9d-655c47fbd5

FailedCreate

Error creating: pods "payload-processing-e2e-derive-46564b9d-655c47fbd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-derive-46564b9d: serviceaccount "payload-processing-e2e-derive-46564b9d" not found

openshift-ingress

replicaset-controller

e2e-explicit-20cf96-openshift-default-77b4f5d8b8

SuccessfulCreate

Created pod: e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

openshift-ingress

deployment-controller

e2e-explicit-20cf96-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-explicit-20cf96-openshift-default-77b4f5d8b8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

openshift-ingress

multus

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

AddedInterface

Add eth0 [10.133.0.58/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-explicit-20cf96

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-explicit-20cf96-786b67c454 from 0 to 1

openshift-ingress

multus

payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-20cf96-6958956bd5

FailedCreate

Error creating: pods "payload-processing-e2e-explicit-20cf96-6958956bd5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-20cf96: serviceaccount "payload-processing-e2e-explicit-20cf96" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-20cf96-786b67c454

FailedCreate

Error creating: pods "payload-pre-processing-e2e-explicit-20cf96-786b67c454-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-explicit-20cf96: serviceaccount "payload-processing-e2e-explicit-20cf96" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-explicit-20cf96-786b67c454

SuccessfulCreate

Created pod: payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

openshift-ingress

deployment-controller

payload-processing-e2e-explicit-20cf96

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-explicit-20cf96-6958956bd5 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-explicit-20cf96-6958956bd5

SuccessfulCreate

Created pod: payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7
(x2)

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Started

Started container istio-proxy

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

ProbeError

Readiness probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Unhealthy

Readiness probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Unhealthy

Startup probe failed: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

ProbeError

Startup probe error: Get "http://10.133.0.58:15021/healthz/ready": dial tcp 10.133.0.58:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

ProbeError

Startup probe error: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused body:
(x6)

openshift-ingress

kubelet

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

Unhealthy

Startup probe failed: Get "http://10.134.0.47:15021/healthz/ready": dial tcp 10.134.0.47:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-derive-46564b9d-655c47fbd5-8d89q

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-derive-46564b9d-685c97f454-gfzcm

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-derive-46564b9d-openshift-default-7888f5fbd-v4rhf

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-explicit-20cf96-6958956bd5-nkfr7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-explicit-20cf96-786b67c454-9qstx

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-explicit-20cf96-openshift-default-77b4f5d8b8-9f96q

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

multus

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-noten-536240

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-noten-536240

openshift-ingress

replicaset-controller

e2e-noten-536240-openshift-default-5b558f7c56

SuccessfulCreate

Created pod: e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

openshift-ingress

deployment-controller

e2e-noten-536240-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-noten-536240-openshift-default-5b558f7c56 from 0 to 1

openshift-ingress

kubelet

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

Created

Created container: istio-proxy

openshift-ingress

kubelet

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine

openshift-ingress

kubelet

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-a-95669b-b88688fc4-8gw6k

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-inf-a-95669b-84f6674b87-zwl8p

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-inf-a-95669b-openshift-default-559bbb4544-79xn8

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-processing-e2e-inf-b-425b2c-798c74d9bc-p994c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-inf-b-425b2c-854978865d-mksn4

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-inf-b-425b2c-openshift-default-658cc4654d-9m68l

Killing

Stopping container istio-proxy

openshift-ingress

deployment-controller

e2e-shared-a-w3-838a68-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w3-838a68-openshift-default-d7777b99b from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-a-w3-838a68-openshift-default-d7777b99b

SuccessfulCreate

Created pod: e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w3-838a68

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w3-838a68

openshift-ingress

multus

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

AddedInterface

Add eth0 [10.133.0.60/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-838a68: serviceaccount "payload-processing-e2e-shared-a-w3-838a68" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w3-838a68

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w3-838a68-75b788b7dc from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w3-838a68: serviceaccount "payload-processing-e2e-shared-a-w3-838a68" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w3-838a68

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8 from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes

openshift-ingress

multus

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

Started

Started container payload-pre-processing

openshift-ingress

gateway_labeler_controller

e2e-mt-2fe44c90

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-2fe44c90

openshift-ingress

deployment-controller

e2e-mt-2fe44c90-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-2fe44c90-openshift-default-86f59b487b from 0 to 1

openshift-ingress

replicaset-controller

e2e-mt-2fe44c90-openshift-default-86f59b487b

SuccessfulCreate

Created pod: e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

openshift-ingress

multus

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

AddedInterface

Add eth0 [10.133.0.61/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

Created

Created container: payload-processing

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-2fe44c90

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-2fe44c90-68fb58b6 from 0 to 1

openshift-ingress

multus

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9

Created

Created container: payload-pre-processing

openshift-ingress

deployment-controller

payload-processing-e2e-mt-2fe44c90

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-2fe44c90-6c8d7765c from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

Started

Started container payload-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2fe44c90-6c8d7765c

SuccessfulCreate

Created pod: payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

openshift-ingress

kubelet

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Unhealthy

Readiness probe failed: Get "http://10.133.0.60:15021/healthz/ready": read tcp 10.133.0.2:50180->10.133.0.60:15021: read: connection reset by peer

openshift-ingress

multus

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

ProbeError

Readiness probe error: Get "http://10.133.0.60:15021/healthz/ready": read tcp 10.133.0.2:50180->10.133.0.60:15021: read: connection reset by peer body:

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-2fe44c90-6c8d7765c

FailedCreate

Error creating: pods "payload-processing-e2e-mt-2fe44c90-6c8d7765c-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2fe44c90: serviceaccount "payload-processing-e2e-mt-2fe44c90" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-2fe44c90: serviceaccount "payload-processing-e2e-mt-2fe44c90" not found
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

ProbeError

Startup probe error: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Unhealthy

Startup probe failed: Get "http://10.133.0.60:15021/healthz/ready": dial tcp 10.133.0.60:15021: connect: connection refused

openshift-ingress

kubelet

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-noten-536240-openshift-default-5b558f7c56-t9hlh

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w3-bb9b64

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w3-bb9b64

openshift-ingress

deployment-controller

e2e-shared-b-w3-bb9b64-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d from 0 to 1

openshift-ingress

replicaset-controller

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d

SuccessfulCreate

Created pod: e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

openshift-ingress

multus

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

AddedInterface

Add eth0 [10.133.0.63/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w3-bb9b64

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w3-bb9b64

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699 from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bb9b64: serviceaccount "payload-processing-e2e-shared-b-w3-bb9b64" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w3-bb9b64: serviceaccount "payload-processing-e2e-shared-b-w3-bb9b64" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx
(x2)

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Started

Started container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes
(x2)

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Created

Created container: istio-proxy

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn
(x5)

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Unhealthy

Startup probe failed: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

ProbeError

Startup probe error: Get "http://10.133.0.61:15021/healthz/ready": dial tcp 10.133.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Unhealthy

Readiness probe failed: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

ProbeError

Readiness probe error: Get "http://10.133.0.63:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Unhealthy

Startup probe failed: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

ProbeError

Startup probe error: Get "http://10.133.0.63:15021/healthz/ready": dial tcp 10.133.0.63:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

Unhealthy

Readiness probe failed: dial tcp 10.134.0.52:9004: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-2fe44c90-6c8d7765c-fskb7

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-2fe44c90-68fb58b6-w68z9

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-mt-2fe44c90-openshift-default-86f59b487b-hmwrm

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

replicaset-controller

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6

SuccessfulCreate

Created pod: e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

openshift-ingress

gateway_labeler_controller

e2e-shared-a-w2-69606d

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-a-w2-69606d

openshift-ingress

deployment-controller

e2e-shared-a-w2-69606d-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6 from 0 to 1

openshift-ingress

multus

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

AddedInterface

Add eth0 [10.133.0.64/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5

FailedCreate

Error creating: pods "payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-69606d: serviceaccount "payload-processing-e2e-shared-a-w2-69606d" not found
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-a-w2-69606d: serviceaccount "payload-processing-e2e-shared-a-w2-69606d" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-a-w2-69606d

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-shared-a-w2-69606d

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5 from 0 to 1

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5

SuccessfulCreate

Created pod: payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

Created

Created container: payload-processing

openshift-ingress

multus

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

Started

Started container payload-pre-processing

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Unhealthy

Readiness probe failed: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

ProbeError

Readiness probe error: Get "http://10.133.0.64:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Unhealthy

Startup probe failed: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

ProbeError

Startup probe error: Get "http://10.133.0.64:15021/healthz/ready": dial tcp 10.133.0.64:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d

SuccessfulCreate

Created pod: e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

openshift-ingress

multus

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

openshift-ingress

GatewayAuthBootstrap

e2e-shared-b-w2-489cdd

ReconcileError

Failed to reconcile EnvoyFilter: failed to create EnvoyFilter: could not CREATE EnvoyFilter openshift-ingress/e2e-shared-b-w2-489cdd-authn-ssl: envoyfilters.networking.istio.io "e2e-shared-b-w2-489cdd-authn-ssl" already exists

openshift-ingress

gateway_labeler_controller

e2e-shared-b-w2-489cdd

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-shared-b-w2-489cdd

openshift-ingress

deployment-controller

e2e-shared-b-w2-489cdd-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-shared-b-w2-489cdd

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd: serviceaccount "payload-processing-e2e-shared-b-w2-489cdd" not found

openshift-ingress

deployment-controller

payload-processing-e2e-shared-b-w2-489cdd

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f

SuccessfulCreate

Created pod: payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f

FailedCreate

Error creating: pods "payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-shared-b-w2-489cdd: serviceaccount "payload-processing-e2e-shared-b-w2-489cdd" not found

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

openshift-ingress

multus

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

Started

Started container payload-pre-processing
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

Unhealthy

Startup probe failed: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused
(x5)

openshift-ingress

kubelet

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

ProbeError

Startup probe error: Get "http://10.134.0.56:15021/healthz/ready": dial tcp 10.134.0.56:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-mt-63d6ac92-openshift-default-5bcf557c5b

SuccessfulCreate

Created pod: e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

openshift-ingress

gateway_labeler_controller

e2e-mt-63d6ac92

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-mt-63d6ac92

openshift-ingress

multus

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

AddedInterface

Add eth0 [10.133.0.67/23] from ovn-kubernetes

openshift-ingress

deployment-controller

e2e-mt-63d6ac92-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-mt-63d6ac92-openshift-default-5bcf557c5b from 0 to 1
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-63d6ac92-5f9969f8cc

FailedCreate

Error creating: pods "payload-processing-e2e-mt-63d6ac92-5f9969f8cc-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-63d6ac92: serviceaccount "payload-processing-e2e-mt-63d6ac92" not found

openshift-ingress

deployment-controller

payload-processing-e2e-mt-63d6ac92

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-mt-63d6ac92-5f9969f8cc from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-mt-63d6ac92

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-mt-63d6ac92: serviceaccount "payload-processing-e2e-mt-63d6ac92" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-mt-63d6ac92-5f9969f8cc

SuccessfulCreate

Created pod: payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

AddedInterface

Add eth0 [10.132.0.76/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v

Created

Created container: payload-pre-processing

openshift-ingress

multus

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v

AddedInterface

Add eth0 [10.132.0.77/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

Created

Created container: payload-processing

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

ProbeError

Readiness probe error: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Unhealthy

Readiness probe failed: Get "http://10.133.0.67:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x5)

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

ProbeError

Startup probe error: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Unhealthy

Startup probe failed: Get "http://10.133.0.67:15021/healthz/ready": dial tcp 10.133.0.67:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-mt-63d6ac92-5f9969f8cc-bxd69

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-mt-63d6ac92

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-mt-63d6ac92: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-mt-63d6ac92": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-mt-63d6ac92, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: 2c065b6d-7033-40c8-91b1-bb4852cac74f, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-mt-63d6ac92-f977c9f9d-kgm7v

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-mt-63d6ac92-openshift-default-5bcf557c5b-dn4gs

Killing

Stopping container istio-proxy

openshift-ingress

gateway_labeler_controller

e2e-api-a-77fac0

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-a-77fac0

openshift-ingress

replicaset-controller

e2e-api-a-77fac0-openshift-default-6ccc45cd5b

SuccessfulCreate

Created pod: e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

openshift-ingress

deployment-controller

e2e-api-a-77fac0-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-a-77fac0-openshift-default-6ccc45cd5b from 0 to 1

openshift-ingress

multus

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

AddedInterface

Add eth0 [10.133.0.72/23] from ovn-kubernetes

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-77fac0-6d6f65f447

SuccessfulCreate

Created pod: payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-77fac0: serviceaccount "payload-processing-e2e-api-a-77fac0" not found

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-a-77fac0

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

openshift-ingress

multus

payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2

AddedInterface

Add eth0 [10.132.0.83/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-a-77fac0-6d6f65f447

FailedCreate

Error creating: pods "payload-processing-e2e-api-a-77fac0-6d6f65f447-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-a-77fac0: serviceaccount "payload-processing-e2e-api-a-77fac0" not found

openshift-ingress

deployment-controller

payload-processing-e2e-api-a-77fac0

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-a-77fac0-6d6f65f447 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2

Started

Started container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

AddedInterface

Add eth0 [10.132.0.84/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

e2e-ipp-a-3f9288-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-a-3f9288-openshift-default-695958d66 from 0 to 1

openshift-ingress

replicaset-controller

e2e-ipp-a-3f9288-openshift-default-695958d66

SuccessfulCreate

Created pod: e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

openshift-ingress

gateway_labeler_controller

e2e-ipp-a-3f9288

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-a-3f9288

openshift-ingress

multus

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f9288-fc9c679f7

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-a-3f9288-fc9c679f7-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f9288: serviceaccount "payload-processing-e2e-ipp-a-3f9288" not found

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

ProbeError

Readiness probe error: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-a-3f9288-fc9c679f7

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-a-3f9288: serviceaccount "payload-processing-e2e-ipp-a-3f9288" not found

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-a-3f9288

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-a-3f9288

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-a-3f9288-fc9c679f7 from 0 to 1

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Unhealthy

Readiness probe failed: Get "http://10.133.0.72:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x2)

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Started

Started container istio-proxy

openshift-ingress

multus

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

AddedInterface

Add eth0 [10.132.0.85/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

Started

Started container payload-pre-processing

openshift-ingress

multus

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

Created

Created container: payload-processing
(x6)

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Unhealthy

Startup probe failed: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

ProbeError

Startup probe error: Get "http://10.133.0.72:15021/healthz/ready": dial tcp 10.133.0.72:15021: connect: connection refused body:

openshift-ingress

deployment-controller

e2e-api-b-ca8280-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-api-b-ca8280-openshift-default-5b67d7d6db from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-api-b-ca8280

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-api-b-ca8280

openshift-ingress

replicaset-controller

e2e-api-b-ca8280-openshift-default-5b67d7d6db

SuccessfulCreate

Created pod: e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

openshift-ingress

multus

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

AddedInterface

Add eth0 [10.133.0.75/23] from ovn-kubernetes
(x4)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8

FailedCreate

Error creating: pods "payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ca8280: serviceaccount "payload-processing-e2e-api-b-ca8280" not found
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ca8280-7f54f7c957

FailedCreate

Error creating: pods "payload-processing-e2e-api-b-ca8280-7f54f7c957-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-api-b-ca8280: serviceaccount "payload-processing-e2e-api-b-ca8280" not found

openshift-ingress

replicaset-controller

payload-processing-e2e-api-b-ca8280-7f54f7c957

SuccessfulCreate

Created pod: payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

openshift-ingress

deployment-controller

payload-processing-e2e-api-b-ca8280

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-api-b-ca8280-7f54f7c957 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8

SuccessfulCreate

Created pod: payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

openshift-ingress

deployment-controller

payload-pre-processing-e2e-api-b-ca8280

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8 from 0 to 1

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

Started

Started container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

multus

payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

AddedInterface

Add eth0 [10.132.0.87/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

Created

Created container: payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

AddedInterface

Add eth0 [10.132.0.86/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

Started

Started container istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

Unhealthy

Startup probe failed: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

ProbeError

Startup probe error: Get "http://10.134.0.59:15021/healthz/ready": dial tcp 10.134.0.59:15021: connect: connection refused body:

openshift-ingress

replicaset-controller

e2e-ipp-b-2ebeba-openshift-default-64f767b44b

SuccessfulCreate

Created pod: e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

openshift-ingress

deployment-controller

e2e-ipp-b-2ebeba-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-b-2ebeba-openshift-default-64f767b44b from 0 to 1

openshift-ingress

gateway_labeler_controller

e2e-ipp-b-2ebeba

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-b-2ebeba

openshift-ingress

multus

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-b-2ebeba

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f from 0 to 1

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-b-2ebeba

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b from 0 to 1

openshift-ingress

multus

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r

AddedInterface

Add eth0 [10.132.0.88/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r

Started

Started container payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

Started

Started container payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

Created

Created container: payload-pre-processing

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r
(x5)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2ebeba: serviceaccount "payload-processing-e2e-ipp-b-2ebeba" not found

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-b-2ebeba: serviceaccount "payload-processing-e2e-ipp-b-2ebeba" not found

openshift-ingress

multus

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r

Created

Created container: payload-processing
(x2)

openshift-ingress

kubelet

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

Created

Created container: istio-proxy
(x5)

openshift-ingress

kubelet

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

ProbeError

Startup probe error: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

Unhealthy

Startup probe failed: Get "http://10.133.0.75:15021/healthz/ready": dial tcp 10.133.0.75:15021: connect: connection refused
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Started

Started container istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Created

Created container: istio-proxy
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Unhealthy

Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused
(x6)

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

ProbeError

Startup probe error: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused body:

openshift-ingress

kubelet

payload-pre-processing-e2e-api-a-77fac0-5ddcb9677d-5vhkh

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-api-a-77fac0-6d6f65f447-xxcb2

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

e2e-api-a-77fac0-openshift-default-6ccc45cd5b-q7rch

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

payload-processing-e2e-api-b-ca8280-7f54f7c957-rg8zc

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-api-b-ca8280-6c7db9f7c8-f6s99

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-api-b-ca8280-openshift-default-5b67d7d6db-47ppr

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w2-69606d-69d7b67b4b-spp9g

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w2-69606d-5d6f5ccc5-ndzzk

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-shared-a-w2-69606d

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-shared-a-w2-69606d: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-shared-a-w2-69606d": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-shared-a-w2-69606d, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: abfb2979-9792-482b-a630-c6ad43f8cb6f, UID in object meta:

openshift-ingress

kubelet

e2e-shared-a-w2-69606d-openshift-default-6cbc56f7c6-qc7fc

Killing

Stopping container istio-proxy

openshift-ingress

multus

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

AddedInterface

Add eth0 [10.133.0.78/23] from ovn-kubernetes

openshift-ingress

gateway_labeler_controller

e2e-ipp-cleanup-64178b

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway e2e-ipp-cleanup-64178b

openshift-ingress

replicaset-controller

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96

SuccessfulCreate

Created pod: e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

openshift-ingress

deployment-controller

e2e-ipp-cleanup-64178b-openshift-default

ScalingReplicaSet

Scaled up replica set e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96 from 0 to 1

openshift-ingress

deployment-controller

payload-processing-e2e-ipp-cleanup-64178b

ScalingReplicaSet

Scaled up replica set payload-processing-e2e-ipp-cleanup-64178b-57d668fc55 from 0 to 1

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb

SuccessfulCreate

Created pod: payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w2-489cdd-77cc68c6b-pnbt5

Killing

Stopping container payload-pre-processing

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55

SuccessfulCreate

Created pod: payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79
(x6)

openshift-ingress

replicaset-controller

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55

FailedCreate

Error creating: pods "payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-64178b: serviceaccount "payload-processing-e2e-ipp-cleanup-64178b" not found

openshift-ingress

multus

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79

AddedInterface

Add eth0 [10.132.0.95/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

deployment-controller

payload-pre-processing-e2e-ipp-cleanup-64178b

ScalingReplicaSet

Scaled up replica set payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb from 0 to 1

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w2-489cdd-5ccd88695f-8rzdn

Killing

Stopping container payload-processing

openshift-ingress

multus

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

AddedInterface

Add eth0 [10.132.0.94/23] from ovn-kubernetes

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

Pulled

Container image "quay.io/opendatahub/odh-ai-gateway-payload-processing:odh-stable" already present on machine

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

Created

Created container: payload-pre-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

Started

Started container payload-pre-processing
(x5)

openshift-ingress

replicaset-controller

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb

FailedCreate

Error creating: pods "payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-" is forbidden: error looking up service account openshift-ingress/payload-processing-e2e-ipp-cleanup-64178b: serviceaccount "payload-processing-e2e-ipp-cleanup-64178b" not found

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79

Created

Created container: payload-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79

Started

Started container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w2-489cdd-openshift-default-6c46c9846d-qx9lq

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Unhealthy

Readiness probe failed: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

ProbeError

Readiness probe error: Get "http://10.133.0.78:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Created

Created container: istio-proxy
(x2)

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

ProbeError

Startup probe error: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused body:
(x5)

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Unhealthy

Startup probe failed: Get "http://10.133.0.78:15021/healthz/ready": dial tcp 10.133.0.78:15021: connect: connection refused

openshift-ingress

kubelet

payload-processing-e2e-ipp-cleanup-64178b-57d668fc55-zvg79

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-cleanup-64178b-7bf9f56fdb-k9bf6

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-cleanup-64178b-openshift-default-6cd7cf5b96-7r4rv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

Killing

Stopping container payload-processing

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-a-3f9288-59f79ffcd-4hpt8

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-ipp-a-3f9288-fc9c679f7-q7h5c

Unhealthy

Readiness probe failed: dial tcp 10.134.0.60:9004: i/o timeout

openshift-ingress

kubelet

e2e-ipp-a-3f9288-openshift-default-695958d66-pvm49

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-processing-e2e-ipp-b-2ebeba-5c4c5d674f-chj7r

Killing

Stopping container payload-processing

openshift-ingress

endpoint-controller

payload-pre-processing-e2e-ipp-b-2ebeba

FailedToUpdateEndpoint

Failed to update endpoint openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba: Operation cannot be fulfilled on endpoints "payload-pre-processing-e2e-ipp-b-2ebeba": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/openshift-ingress/payload-pre-processing-e2e-ipp-b-2ebeba, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: d1926258-b12b-4a91-be5f-3fb0f201a853, UID in object meta:

openshift-ingress

kubelet

payload-pre-processing-e2e-ipp-b-2ebeba-77c654fb6b-n5xnn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-ipp-b-2ebeba-openshift-default-64f767b44b-f5lgl

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-a-w3-838a68-5c9675d8f8-l98lt

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-a-w3-838a68-75b788b7dc-4d59b

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-a-w3-838a68-openshift-default-d7777b99b-glbxc

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

payload-pre-processing-e2e-shared-b-w3-bb9b64-8f4fb8858-ql5mn

Killing

Stopping container payload-pre-processing

openshift-ingress

kubelet

payload-processing-e2e-shared-b-w3-bb9b64-68db9b6699-rwgzx

Killing

Stopping container payload-processing

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Killing

Stopping container istio-proxy

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

e2e-shared-b-w3-bb9b64-openshift-default-7dbbcd994d-bk9sv

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503